-- Logs begin at Wed 2021-12-15 13:19:04 UTC, end at Wed 2021-12-15 14:34:18 UTC. -- Dec 15 14:04:37.776652 dv-cinder-813229-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 14:04:37.786594 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 14:04:37 2021] *** Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: nodename: dv-cinder-813229-4-iscsi Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: machine: x86_64 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: clock source: unix Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: pcre jit disabled Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: detected number of CPU cores: 4 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: current working directory: / Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: detected binary path: /usr/bin/uwsgi-core Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: your processes number limit is 47680 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: your memory page size is 4096 bytes Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: detected max file descriptor number: 2048 Dec 15 14:04:37.788574 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: lock engine: pthread robust mutexes Dec 15 14:04:37.789982 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: thunder lock: enabled Dec 15 14:04:37.789982 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 14:04:37.789982 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 14:04:37.833880 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: Python main interpreter initialized at 0x5578c69ad9c0 Dec 15 14:04:37.833880 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: python threads support enabled Dec 15 14:04:37.833880 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: your server socket listen backlog is limited to 100 connections Dec 15 14:04:37.833880 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: your mercy for graceful operations on workers is 90 seconds Dec 15 14:04:37.834296 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 14:04:37.834296 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: *** Operational MODE: preforking *** Dec 15 14:04:37.834563 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: *** uWSGI is running in multiple interpreter mode *** Dec 15 14:04:37.834563 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: spawned uWSGI master process (pid: 102448) Dec 15 14:04:37.834773 dv-cinder-813229-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 14:04:37.835876 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: spawned uWSGI worker 1 (pid: 102449, cores: 1) Dec 15 14:04:37.835876 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: spawned uWSGI worker 2 (pid: 102450, cores: 1) Dec 15 14:04:37.835876 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 14:04:39.581727 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:04:39.581727 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: from cryptography.utils import int_from_bytes Dec 15 14:04:39.582409 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:04:39.582409 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: from cryptography.utils import int_from_bytes Dec 15 14:04:39.600209 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:04:39.600209 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: from cryptography.utils import int_from_bytes Dec 15 14:04:39.600765 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:04:39.600765 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: from cryptography.utils import int_from_bytes Dec 15 14:04:42.211671 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:04:42.212338 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:04:42.212434 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:04:42.212788 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:04:42.213044 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:04:42.213429 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.213753 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.214075 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.214394 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.214728 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.215033 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.215350 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.215670 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.216024 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.216287 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.216603 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.216926 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-4-iscsi {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.217251 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.217558 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.217869 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.218187 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.218491 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.218815 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.219119 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.219630 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.220094 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.220432 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.220747 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.221108 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.221407 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.221720 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.222298 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.222607 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.222930 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.223242 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.223640 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-4-iscsi {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.223745 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:04:42.224173 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.224283 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.224491 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:04:42.224654 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.224980 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:04:42.225133 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.225297 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.225431 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:04:42.225598 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:04:42.225685 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.225917 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226008 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226240 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226331 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226549 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226647 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226876 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.226962 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227221 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227328 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227521 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227632 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227834 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.227977 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228163 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228269 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228470 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228558 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228733 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.228823 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229046 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229129 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229366 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-4-iscsi {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229463 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229667 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229757 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.229916 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230001 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230224 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230315 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230543 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230628 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230856 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.230958 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231175 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231331 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231424 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231521 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231662 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.231992 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232106 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232305 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232408 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232608 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232702 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.232912 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233004 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233218 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233335 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233525 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233610 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233830 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.233921 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234136 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234231 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234437 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234533 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234740 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.234831 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235049 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235142 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235362 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235448 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-4-iscsi {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235680 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.235855 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.236037 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.236493 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.236578 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.236846 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.236939 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237136 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237275 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237446 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237571 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237786 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.237887 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238103 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238197 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238414 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238507 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238734 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.238824 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239054 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239147 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239359 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239451 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239664 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239772 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.239993 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240092 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240316 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240403 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240619 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240710 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.240951 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.241206 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.241508 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.241815 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.242134 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.242442 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.242584 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.242749 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.242930 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243056 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243251 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243345 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243571 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243666 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243829 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.243946 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244177 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244497 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244590 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244697 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244877 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.244987 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245136 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245231 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245391 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245485 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245642 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245741 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.245963 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246049 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246286 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246372 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246597 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246684 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246904 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.246995 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247208 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247291 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247512 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247597 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247816 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.247913 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248161 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248260 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248465 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248550 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248772 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.248861 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249087 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249182 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249392 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249478 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249699 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.249786 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250002 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250086 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250311 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250401 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250619 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250722 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.250935 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.251031 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.251238 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.251333 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.252312 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.252929 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.253283 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.253771 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.253865 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.253945 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254128 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254215 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254455 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254550 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254789 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.254875 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255104 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255194 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255411 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255508 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255712 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.255804 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256048 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256136 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256369 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256454 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256680 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256772 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.256989 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257080 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257239 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257330 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257545 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257636 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257853 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.257944 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.258174 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.258261 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.258484 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.258568 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.258792 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.258878 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.259099 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.259185 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.259404 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.259490 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.259711 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.259804 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.260044 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.260142 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.260351 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.260436 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.260658 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.260760 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.260963 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.261054 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.261266 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.261352 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.261569 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.261662 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.261874 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.261960 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.262175 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.262259 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.262491 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.262584 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.262809 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.262899 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.263113 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.263198 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.263418 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.263510 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.263722 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.263806 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.264051 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.264156 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.264375 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.264471 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.264680 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.264772 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.264984 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.265116 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.265305 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.265439 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.265608 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.265692 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.265911 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.266039 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.266229 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.266322 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.266536 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.266629 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.266841 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.266926 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.267857 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.267978 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.268274 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.268594 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.268678 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.268906 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.269004 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.269229 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.269314 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.269540 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.269632 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.269847 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.269942 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.270159 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.270244 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.270480 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.270564 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.270788 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.270882 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.271097 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.271203 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.271404 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.271490 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.271705 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.271791 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.272034 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.272138 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.272354 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.272444 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.272674 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.272770 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.272977 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.273070 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.273279 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.273363 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.273582 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.273669 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.273900 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:04:42.273986 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274209 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274299 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274516 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274603 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274828 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.274914 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275138 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275231 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275445 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275531 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275770 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.275855 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276108 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276214 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276415 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276501 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276729 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.276813 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277034 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277131 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277339 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277426 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277645 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277729 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.277954 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278052 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278264 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278355 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278575 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278660 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278898 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.278991 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279207 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279293 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279516 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279600 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279835 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.279937 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280172 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280257 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280486 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280571 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280809 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.280894 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281122 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281207 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281428 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281512 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281730 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.281815 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282049 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282135 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282356 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282449 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282701 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.282847 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.283101 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.283418 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.283505 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.283729 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.283816 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284066 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284157 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284379 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284467 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284687 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284774 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.284993 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285079 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285321 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285406 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285632 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285719 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.285938 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286023 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286244 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286338 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286550 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286643 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286879 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.286963 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287182 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287281 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287487 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287581 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287796 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.287881 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288137 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288239 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288457 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288544 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288785 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.288877 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289090 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289257 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289397 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289482 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289713 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.289800 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290022 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290107 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290330 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290413 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290628 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290714 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.290938 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291032 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291248 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291334 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291550 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291635 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.291883 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292011 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292280 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292366 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292585 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292669 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292892 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.292978 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293195 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293279 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293499 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293591 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293811 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.293898 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294119 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294211 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294427 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294521 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294735 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.294827 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295055 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295146 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295364 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295458 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295672 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.295756 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296009 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296097 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296324 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296421 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296639 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296723 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.296948 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297032 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297271 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297365 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297583 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297668 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297883 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.297966 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.298192 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.298298 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.298749 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.299082 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.299305 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.299400 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.299692 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.299909 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.300089 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.300332 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.300555 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.300642 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.300931 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301183 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301271 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301521 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301606 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301842 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.301936 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302150 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302235 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302453 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302537 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302755 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.302862 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303056 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303182 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303398 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303485 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303701 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.303794 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304065 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304155 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304404 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304490 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304724 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.304811 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305039 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305124 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305350 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305443 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305662 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305751 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.305972 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306076 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306279 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306384 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306583 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306670 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306889 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.306989 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307206 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307304 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307517 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307610 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307832 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.307972 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308169 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308324 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308476 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308562 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308786 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.308919 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309108 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309239 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309406 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309499 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309710 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.309795 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310014 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310108 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310322 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310417 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310670 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310755 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.310982 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311066 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311288 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311373 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311601 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311688 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.311912 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312028 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312241 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312328 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312551 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312636 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312857 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.312944 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313165 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313249 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313471 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313554 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313789 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.313891 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.314641 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.314958 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315071 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315273 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315449 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315585 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315765 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.315907 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316113 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316216 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316421 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316550 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316737 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.316824 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317065 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317159 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317400 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317485 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317711 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.317794 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318023 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318117 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318347 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318601 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318687 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.318938 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319037 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319245 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319330 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319548 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319633 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.319859 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320042 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320199 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320285 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320514 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320599 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320822 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.320916 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321133 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321226 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321438 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321526 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321748 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.321841 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322051 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322137 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322352 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322444 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322650 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322735 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.322955 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323038 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323264 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323357 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323570 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323671 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323880 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.323993 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324209 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324304 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324512 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324598 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324813 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.324898 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325134 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325233 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325443 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325546 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325742 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.325826 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326041 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326127 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326343 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326438 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326662 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326746 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.326971 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327056 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327277 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327365 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327581 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327675 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327885 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.327998 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328217 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328304 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328531 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328618 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328840 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.328926 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.329146 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.329241 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.329471 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.329651 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.330354 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.330662 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.330824 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.330989 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331143 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331295 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331457 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331599 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331772 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.331909 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332113 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332246 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332425 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332555 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332750 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.332858 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333057 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333170 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333367 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333483 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333678 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333793 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.333981 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.334102 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.334289 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.334406 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.334605 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.334713 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335015 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335174 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335331 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335504 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335639 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335815 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.335966 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336157 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336277 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336474 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336589 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336791 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.336899 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337119 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337213 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337444 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337536 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337754 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.337839 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338061 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338156 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338370 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338455 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338672 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338762 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.338972 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339057 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339276 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339360 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339577 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339669 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.339877 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340069 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340205 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340290 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340511 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340603 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340811 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.340898 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341111 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341194 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341419 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341505 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341726 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.341821 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342029 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342116 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342327 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342412 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342636 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342731 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.342936 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343021 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343245 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343329 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343548 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343641 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343850 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.343955 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344177 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344263 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344478 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344565 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344786 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.344870 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.345092 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.345209 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.345421 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.345726 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.345966 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.346052 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.346307 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.346392 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.346638 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.346731 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.347207 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.347301 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.347518 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.347844 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.348174 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.348479 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.348564 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.348867 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.348955 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349110 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349188 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349417 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349503 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349718 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.349803 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350026 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350121 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350339 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350463 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350648 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350742 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.350954 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351041 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351256 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351342 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351563 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351647 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351862 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.351997 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352198 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352285 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352504 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352598 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352803 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.352889 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353101 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353186 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353406 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353500 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353708 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.353791 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354005 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354090 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354312 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354410 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354611 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354696 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.354924 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355016 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355227 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355321 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355526 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355619 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355826 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.355911 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356160 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356250 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356467 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356551 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356765 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.356849 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357073 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357157 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357380 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357465 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357679 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357763 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.357980 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358075 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358286 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358378 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358585 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358672 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.358885 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359025 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359187 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359279 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359495 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359589 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359805 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.359891 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.360134 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.360221 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.360440 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.360537 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.360744 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.361337 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.361815 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.361989 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.362303 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.362399 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.362615 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.362788 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.362918 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363115 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363225 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363432 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363518 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363820 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.363903 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364151 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364251 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364474 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364568 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364828 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.364921 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365085 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365262 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365388 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365477 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365689 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.365775 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366016 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366109 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366319 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366404 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366675 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366760 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.366977 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367280 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367388 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367471 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367592 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367679 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.367901 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368009 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368236 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368325 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368546 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368631 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368844 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.368930 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369155 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369252 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369462 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369547 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369767 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.369854 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370065 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370164 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370370 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370456 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370689 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370779 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.370994 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.371091 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.371407 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.371503 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.371711 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.371803 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372074 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372163 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372398 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372497 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372698 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.372785 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373004 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373098 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373308 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373410 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373612 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373698 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.373915 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374002 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374220 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374383 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374528 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374615 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374835 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.374920 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375140 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375229 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375445 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375531 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375750 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.375838 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.376076 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.376178 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.376409 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.377049 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.377421 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.377741 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.377847 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378069 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378154 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378401 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378496 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378716 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.378812 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379023 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379120 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379336 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379423 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379642 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379735 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.379974 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380064 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380285 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380369 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380641 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380734 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.380946 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381032 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381253 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381338 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381577 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381664 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381884 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.381970 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382197 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382289 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382508 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382596 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382820 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.382905 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383119 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383212 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383421 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383537 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383747 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.383833 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384082 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384185 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384410 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384498 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384727 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.384813 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385040 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385135 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385350 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385436 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385654 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385739 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.385977 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386072 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386286 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386414 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386593 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386680 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386898 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.386995 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387200 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387338 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387520 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387608 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387832 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.387919 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.388181 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.388329 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.388512 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.388634 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.388842 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389048 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389143 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389357 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389473 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389664 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389799 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.389984 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390116 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390308 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390434 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390630 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390759 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.390931 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391064 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391239 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391370 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391543 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391680 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.391863 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.392561 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.392890 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393157 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393256 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393480 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393645 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393789 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.393875 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394092 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394179 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394394 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394491 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394717 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.394805 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395022 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395166 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395342 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395437 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395648 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395755 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.395972 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396106 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396282 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396415 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396584 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396737 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.396928 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397063 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397232 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397367 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397566 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397660 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397887 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.397980 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398210 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398298 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398538 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398624 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398848 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.398934 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399149 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399235 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399458 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399544 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399766 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.399862 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400099 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400187 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400408 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400549 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400710 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.400810 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401023 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401108 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401323 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401408 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401634 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401728 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.401942 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402027 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402256 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402341 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402570 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402664 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.402871 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403132 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403218 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403462 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403559 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403769 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.403875 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404103 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404190 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404402 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404504 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404716 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.404814 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405029 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405115 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405339 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405432 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405652 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405738 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.405962 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406051 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406265 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406366 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406590 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406682 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406908 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.406993 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.407218 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.407313 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.407530 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.407657 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.408524 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.408941 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409041 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409249 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409342 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409555 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409641 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409864 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.409963 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410168 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410256 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410475 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410562 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410784 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.410933 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411094 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411183 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411396 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411482 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411698 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.411786 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412022 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412113 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412345 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412444 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412648 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412743 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.412961 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413059 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413265 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413361 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413566 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413660 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413868 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.413955 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414166 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414261 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414504 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414593 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414807 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.414902 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415124 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415218 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415437 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415523 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415754 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.415846 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416103 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416301 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416412 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416618 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416754 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.416954 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417054 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417282 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417375 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417607 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417694 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.417926 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418019 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418240 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418329 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418551 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418638 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418857 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.418950 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419164 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419250 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419472 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419556 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419776 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.419864 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420106 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420194 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420429 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420666 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420769 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.420993 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421080 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421305 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421399 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421614 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421709 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.421922 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422145 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422238 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422501 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422595 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422820 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.422915 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.423124 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.423216 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.423561 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.423986 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424098 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424264 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424351 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424593 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424680 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424903 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.424992 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425211 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425306 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425531 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425619 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425844 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.425933 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426151 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426237 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426455 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426551 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426766 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.426852 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427074 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427173 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427378 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427478 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427689 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.427783 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428025 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428117 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428339 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428440 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428649 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428735 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.428955 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429042 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429261 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429349 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429570 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429656 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429874 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.429962 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430179 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430277 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430484 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430571 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430788 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.430878 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431095 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431182 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431399 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431486 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431708 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.431803 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432040 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432130 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432361 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432448 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432667 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432766 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.432979 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433066 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433284 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433572 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433659 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433892 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.433981 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434195 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434282 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434510 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434597 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434819 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.434911 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435142 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435228 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435454 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435549 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435763 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.435848 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436096 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436184 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436399 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436503 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436709 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.436958 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437046 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437304 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437389 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437626 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437714 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.437934 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438020 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438237 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438324 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438556 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438651 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.438866 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.439016 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.439227 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.439548 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.439863 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440015 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440200 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440370 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440512 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440693 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.440825 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441022 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441137 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441349 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441436 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441668 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441764 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.441975 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442073 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442300 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442387 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442606 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442701 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.442910 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443007 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443224 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443320 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443535 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443622 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443839 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.443945 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444168 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444272 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444479 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444566 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444787 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.444873 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445087 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445181 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445393 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445478 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445690 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.445786 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446016 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446104 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446321 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446407 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446622 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446717 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.446924 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447054 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447233 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447328 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447533 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447649 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.447833 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448000 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448162 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448315 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448464 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448639 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448773 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.448965 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449060 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449279 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449366 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449601 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449689 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.449914 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450008 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450236 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450321 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450550 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450638 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450850 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.450937 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451172 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451299 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451473 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451560 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451773 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.451866 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452108 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452208 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452416 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452501 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452737 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.452830 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453047 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453209 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453357 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453444 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453685 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.453771 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.454001 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.454096 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.454327 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.455040 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.455252 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.455590 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.455916 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456046 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456261 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456354 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456578 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456664 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.456916 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457011 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457225 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457314 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457533 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457621 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457839 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.457926 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458150 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458235 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458462 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458560 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458772 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.458864 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459077 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459170 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459384 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459472 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459694 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.459782 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460033 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460123 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460344 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460443 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460653 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460742 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.460966 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461052 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461275 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461410 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461608 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461696 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.461921 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462008 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462235 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462331 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462546 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462633 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462859 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.462945 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463166 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463264 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463475 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463561 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463784 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.463870 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464119 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464208 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464434 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464521 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464762 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.464848 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465074 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465167 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465377 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465463 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465744 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.465842 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466073 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466167 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466392 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466480 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466708 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.466803 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.467015 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.467102 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.467259 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:04:42.467346 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.467639 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.467974 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.468292 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.468602 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.468930 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.469267 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.469595 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.469919 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.470777 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.471523 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.471838 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.472538 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.472883 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.473223 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.473544 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.473870 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.474184 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.474512 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.474823 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.475145 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.475468 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.475787 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.476135 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.476467 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.476780 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.477091 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.477402 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.477713 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.478021 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.478330 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.478657 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.478982 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.479286 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.479610 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.479964 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.480271 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.480587 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.480901 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.481234 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.481546 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.481860 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.482170 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.482481 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.482796 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.483111 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.483435 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.483759 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.484107 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.484434 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.484779 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.485092 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.485436 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.485786 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.486724 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.486990 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.487299 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:04:42.487543 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:04:42.491851 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_db.sqlalchemy.engines [None req-10418023-5122-4490-a937-a747b378c8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.511122 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.559176 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.context [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5558468a-fedb-47cf-8f35-4b962b2baa9f(cell1) {{(pid=102450) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:04:42.563463 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_concurrency.lockutils [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.565387 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_concurrency.lockutils [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.566206 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_concurrency.lockutils [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.568180 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_concurrency.lockutils [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.578823 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.context [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5558468a-fedb-47cf-8f35-4b962b2baa9f(cell1) {{(pid=102449) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:04:42.579020 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_db.sqlalchemy.engines [None req-10418023-5122-4490-a937-a747b378c8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.579352 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_db.sqlalchemy.engines [None req-10418023-5122-4490-a937-a747b378c8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.583962 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.585581 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.586405 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:04:42.588395 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:04:42.601909 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.604290 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.749684 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG oslo_db.sqlalchemy.engines [None req-10418023-5122-4490-a937-a747b378c8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:42.773055 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:04:43.198165 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: WARNING keystonemiddleware.auth_token [None req-10418023-5122-4490-a937-a747b378c8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:04:43.204873 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: WARNING keystonemiddleware.auth_token [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:04:43.216765 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:04:43.223792 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:04:43.546061 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: WARNING keystonemiddleware.auth_token [None req-10418023-5122-4490-a937-a747b378c8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:04:43.551437 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: WARNING keystonemiddleware.auth_token [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:04:43.556604 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578c69ad9c0 pid: 102450 (default app) Dec 15 14:04:43.558680 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:04:43.559892 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-10418023-5122-4490-a937-a747b378c8e3 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Dec 15 14:04:43.560328 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Dec 15 14:04:43 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:04:43.564532 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:04:43.569857 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-79744cdb-303a-4ee0-bb68-2e286cbfffd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:04:43.574962 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578c69ad9c0 pid: 102449 (default app) Dec 15 14:06:10.025454 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:10.026576 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-10418023-5122-4490-a937-a747b378c8e3 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Dec 15 14:06:10.027094 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:10.465740 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-b7f074a2-4725-4592-bf7d-5386eedd3fa3 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:10.496817 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-b7f074a2-4725-4592-bf7d-5386eedd3fa3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.460643 Dec 15 14:06:10.497600 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 14:06:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:12.963585 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-10418023-5122-4490-a937-a747b378c8e3 None None] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:12.964598 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-10418023-5122-4490-a937-a747b378c8e3 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 14:06:12.965263 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:13.035701 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-065da6a3-0bf3-4f50-925f-7cfbfefa04a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:13.055720 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:06:13.055720 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:06:13.131613 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-065da6a3-0bf3-4f50-925f-7cfbfefa04a6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.159405 Dec 15 14:06:13.132128 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:13.378162 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-c8e0f24f-8cfa-485c-bbf7-b646e923b361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:13.380812 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:06:13.380812 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: warnings.warn(msg) Dec 15 14:06:13.495486 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-c8e0f24f-8cfa-485c-bbf7-b646e923b361 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.354821 Dec 15 14:06:13.496214 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 14:06:13 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:06:15.961778 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-065da6a3-0bf3-4f50-925f-7cfbfefa04a6 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:15.962982 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-065da6a3-0bf3-4f50-925f-7cfbfefa04a6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Dec 15 14:06:15.963742 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:16.090981 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-96ec6937-a296-4a6b-bb1d-cf378d4721ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:16.110144 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:06:16.110144 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: warnings.warn(msg) Dec 15 14:06:16.220030 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-96ec6937-a296-4a6b-bb1d-cf378d4721ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.249142 Dec 15 14:06:16.227961 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:16.234865 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-92fd6cd2-f3bc-4d44-9437-94a848c47693 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:16.236403 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:06:16.236403 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:06:16.337386 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-92fd6cd2-f3bc-4d44-9437-94a848c47693 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107079 Dec 15 14:06:16.338145 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 14:06:16 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:06:18.817495 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-96ec6937-a296-4a6b-bb1d-cf378d4721ec admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:18.818652 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-96ec6937-a296-4a6b-bb1d-cf378d4721ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Dec 15 14:06:18.819381 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:18.880359 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-0851e14c-0f11-4371-aafd-bca41edd3bb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:18.976081 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-0851e14c-0f11-4371-aafd-bca41edd3bb8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149888 Dec 15 14:06:18.976633 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:18.991282 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-59c0680a-2ac6-43e2-a183-2afc782aa768 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:19.096850 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-59c0680a-2ac6-43e2-a183-2afc782aa768 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109382 Dec 15 14:06:19.101854 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 14:06:18 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:21.551274 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-0851e14c-0f11-4371-aafd-bca41edd3bb8 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:21.552910 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-0851e14c-0f11-4371-aafd-bca41edd3bb8 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Dec 15 14:06:21.553629 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:21.611948 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7fe8b2aa-c2af-4aba-804d-342f52cc664c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "name": "ds2G", "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:21.692897 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7fe8b2aa-c2af-4aba-804d-342f52cc664c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132799 Dec 15 14:06:21.693477 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:21.706344 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-cec98fbb-3f35-4141-a9e2-e08f5b643929 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:21.788683 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-cec98fbb-3f35-4141-a9e2-e08f5b643929 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086540 Dec 15 14:06:21.789508 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 14:06:21 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:24.321430 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7fe8b2aa-c2af-4aba-804d-342f52cc664c admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:24.322445 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7fe8b2aa-c2af-4aba-804d-342f52cc664c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 15 14:06:24.322864 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:24.393284 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:24.481805 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151722 Dec 15 14:06:24.482359 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:24.494881 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-9fde96ff-cd3b-4d9b-a185-ce713886ac95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:24.554020 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-9fde96ff-cd3b-4d9b-a185-ce713886ac95 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062638 Dec 15 14:06:24.554602 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 14:06:24 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:27.014565 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:27.016355 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002200 Dec 15 14:06:27.016784 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:27.079041 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-0925776d-3cd2-463c-95ad-59aeae69ca90 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:27.102243 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-0925776d-3cd2-463c-95ad-59aeae69ca90 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078924 Dec 15 14:06:27.102783 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 14:06:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:06:29.543844 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:29.544895 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-73b82ec4-33f4-471d-b957-d5190f4c937a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 14:06:29.545298 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:29.613721 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-e660f654-1ed0-4ed2-8898-9ebcbf1dd6df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:29.698724 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-e660f654-1ed0-4ed2-8898-9ebcbf1dd6df admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.145827 Dec 15 14:06:29.699293 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:29 2021] POST /compute/v2.1/flavors => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:29.712227 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-db284ba2-bac1-4d94-ae31-6057fc643211 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:29.778055 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-db284ba2-bac1-4d94-ae31-6057fc643211 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069210 Dec 15 14:06:29.778704 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 14:06:29 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:32.200711 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-e660f654-1ed0-4ed2-8898-9ebcbf1dd6df admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:32.201735 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-e660f654-1ed0-4ed2-8898-9ebcbf1dd6df admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 15 14:06:32.202367 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:32.265787 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-45bec5f9-9dd1-4c0e-9af1-df9d95b27a00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:32.356719 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-45bec5f9-9dd1-4c0e-9af1-df9d95b27a00 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146837 Dec 15 14:06:32.357730 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:32 2021] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:32.373004 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-f9dfa134-a963-4402-895a-3f5fdc2a17c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:32.461657 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-f9dfa134-a963-4402-895a-3f5fdc2a17c0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093668 Dec 15 14:06:32.463213 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 14:06:32 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:34.901243 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-45bec5f9-9dd1-4c0e-9af1-df9d95b27a00 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:34.902260 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-45bec5f9-9dd1-4c0e-9af1-df9d95b27a00 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Dec 15 14:06:34.902675 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:34.962937 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7e858bf0-8b81-4241-babe-7ef871dfa3aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:35.052475 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7e858bf0-8b81-4241-babe-7ef871dfa3aa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.142965 Dec 15 14:06:35.053034 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:34 2021] POST /compute/v2.1/flavors => generated 406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:35.065744 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-fcfb3335-db46-4780-bd9c-2b6523686c4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:35.187102 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-fcfb3335-db46-4780-bd9c-2b6523686c4f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125329 Dec 15 14:06:35.188364 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 14:06:35 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:37.655664 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7e858bf0-8b81-4241-babe-7ef871dfa3aa admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:37.656764 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7e858bf0-8b81-4241-babe-7ef871dfa3aa admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 15 14:06:37.657369 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:37.720108 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e20cf860-29dc-4ec3-81ef-85d457a4daaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:37.852905 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e20cf860-29dc-4ec3-81ef-85d457a4daaf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.189032 Dec 15 14:06:37.854042 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:37 2021] POST /compute/v2.1/flavors => generated 405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:06:37.867169 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-0da8b3e5-3c46-4958-b4c6-9e3a099ace84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:37.964127 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-0da8b3e5-3c46-4958-b4c6-9e3a099ace84 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100529 Dec 15 14:06:37.964971 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 14:06:37 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:06:40.494853 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e20cf860-29dc-4ec3-81ef-85d457a4daaf admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:06:40.495858 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e20cf860-29dc-4ec3-81ef-85d457a4daaf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 15 14:06:40.496516 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:06:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:06:40.561941 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "ram": 16384, "id": "5", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:40.640343 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.136173 Dec 15 14:06:40.641214 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 14:06:40 2021] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:06:40.653553 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-86f4d045-55fa-4a61-abf4-6c0ea3da981a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:06:40.730569 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-86f4d045-55fa-4a61-abf4-6c0ea3da981a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080397 Dec 15 14:06:40.731439 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 14:06:40 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:07:03.450127 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:03.451125 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 15 14:07:03.451525 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:07:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:03.511135 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-07bb30f0-e923-4ae1-8ee6-588c8a9b4857 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:03.529158 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-07bb30f0-e923-4ae1-8ee6-588c8a9b4857 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070109 Dec 15 14:07:03.529706 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 14:07:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:07:05.130296 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:05.131289 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-7e49b4f3-7ec7-46b0-9921-3f0067557def admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Dec 15 14:07:05.131687 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:05.338871 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-0b09e465-1679-4240-a718-b73fccd3282a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:05.345465 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-0b09e465-1679-4240-a718-b73fccd3282a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 14:07:05.346033 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-0b09e465-1679-4240-a718-b73fccd3282a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:05.346825 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-0b09e465-1679-4240-a718-b73fccd3282a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060061 Dec 15 14:07:05.347600 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 14:07:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 14:07:05.357305 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-607e494f-508a-4285-ba3d-e3ac07453b87 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:05.379242 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-607e494f-508a-4285-ba3d-e3ac07453b87 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025361 Dec 15 14:07:05.379815 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:07:05.390083 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-09f7ef1f-50d0-4c9d-bf8d-1f70e6a21d62 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:05.412155 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-09f7ef1f-50d0-4c9d-bf8d-1f70e6a21d62 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025555 Dec 15 14:07:05.412714 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:07:05.423327 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-557349c7-9db6-422f-a0ce-6f960856d9cf admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:05.428826 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.wsgi [None req-557349c7-9db6-422f-a0ce-6f960856d9cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 14:07:05.429881 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-557349c7-9db6-422f-a0ce-6f960856d9cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:05.430674 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-557349c7-9db6-422f-a0ce-6f960856d9cf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011578 Dec 15 14:07:05.431175 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 14:07:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 14:07:06.961723 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-09f7ef1f-50d0-4c9d-bf8d-1f70e6a21d62 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:06.962724 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-09f7ef1f-50d0-4c9d-bf8d-1f70e6a21d62 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Dec 15 14:07:06.963121 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:07.153140 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-b252e79f-f22d-4d52-8d46-fabd20b1c88c admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:07.158911 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.wsgi [None req-b252e79f-f22d-4d52-8d46-fabd20b1c88c admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 14:07:07.159469 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-b252e79f-f22d-4d52-8d46-fabd20b1c88c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:07.160285 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-b252e79f-f22d-4d52-8d46-fabd20b1c88c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059219 Dec 15 14:07:07.160793 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 14:07:07 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 14:07:07.170654 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-7618ced1-e2b9-4e3d-ad97-816da1c702ee admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:07.184627 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-7618ced1-e2b9-4e3d-ad97-816da1c702ee admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017615 Dec 15 14:07:07.185164 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:07:07.195540 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-ee935693-8055-43a3-9b94-60e8da589d8a admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:07.209368 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-ee935693-8055-43a3-9b94-60e8da589d8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017238 Dec 15 14:07:07.209926 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:07:07.219790 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-489062e9-1812-4b4e-a019-213653de165c admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:07.225202 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-489062e9-1812-4b4e-a019-213653de165c admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 14:07:07.225760 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-489062e9-1812-4b4e-a019-213653de165c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:07.226539 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-489062e9-1812-4b4e-a019-213653de165c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010400 Dec 15 14:07:07.227023 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 14:07:07 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 14:07:08.731100 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-ee935693-8055-43a3-9b94-60e8da589d8a admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:08.732140 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-ee935693-8055-43a3-9b94-60e8da589d8a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 15 14:07:08.732543 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:08.925850 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a7d26edd-0a3d-476a-a19b-0b774cfb0fd9 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:08.931093 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-a7d26edd-0a3d-476a-a19b-0b774cfb0fd9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 14:07:08.931640 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a7d26edd-0a3d-476a-a19b-0b774cfb0fd9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:08.932454 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-a7d26edd-0a3d-476a-a19b-0b774cfb0fd9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059239 Dec 15 14:07:08.932958 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:07:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 14:07:08.943732 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-3cc23e0d-a1c9-4ff8-8a45-d9c9bffd98bf admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:08.957742 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-3cc23e0d-a1c9-4ff8-8a45-d9c9bffd98bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017588 Dec 15 14:07:08.958283 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:07:08.969835 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:08.983234 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018502 Dec 15 14:07:08.983760 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 14:07:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:07:08.993769 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-b65a6628-d68c-4dd0-b998-a02052e24526 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:08.998957 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.wsgi [None req-b65a6628-d68c-4dd0-b998-a02052e24526 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 14:07:08.999514 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-b65a6628-d68c-4dd0-b998-a02052e24526 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:07:09.000850 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-b65a6628-d68c-4dd0-b998-a02052e24526 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010618 Dec 15 14:07:09.001343 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:07:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 14:07:10.541803 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:10.542863 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Dec 15 14:07:10.543255 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:10.735443 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-ca83f7dd-9a40-411f-a15d-453a0816ac9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:10.839681 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-ca83f7dd-9a40-411f-a15d-453a0816ac9e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.155374 Dec 15 14:07:10.840426 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 14:07:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:12.346707 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:12.348004 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Dec 15 14:07:12.348408 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:12.540223 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-a83814d0-19e6-4677-b500-0cc8019b4786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:12.605380 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-a83814d0-19e6-4677-b500-0cc8019b4786 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.116006 Dec 15 14:07:12.605929 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 14:07:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:14.116758 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:14.117752 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Dec 15 14:07:14.118144 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:14.315086 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-0851aaa6-e5e1-4757-9959-f02214086962 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:14.423393 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-0851aaa6-e5e1-4757-9959-f02214086962 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.160367 Dec 15 14:07:14.424030 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 14:07:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:07:15.925516 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:15.926512 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 15 14:07:15.926906 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:16.123770 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-f48f7cfe-4875-458a-8dec-3fddf0760d58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:07:16.188568 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-f48f7cfe-4875-458a-8dec-3fddf0760d58 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.120481 Dec 15 14:07:16.189128 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 14:07:16 2021] POST /compute/v2.1/flavors => generated 409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:07:17.855174 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:17.856201 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 15 14:07:17.856593 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:07:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:07:18.052459 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-e35b5ba1-2afd-4a53-8894-c357e794581a admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:07:18.074281 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-e35b5ba1-2afd-4a53-8894-c357e794581a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075167 Dec 15 14:07:18.074765 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Dec 15 14:07:17 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:06.772651 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.780682 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1cdf2fb4-988e-48d2-8c29-508c651b0a92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Dec 15 14:08:06.780682 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:08:06.833873 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-d67693fb-d7b8-460f-b991-f3f03cb502f8 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.854067 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-d67693fb-d7b8-460f-b991-f3f03cb502f8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073505 Dec 15 14:08:06.854639 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:08:06.877245 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-9265edc7-b19d-4da2-a9f6-8928a8fc1f4d admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.884997 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-9265edc7-b19d-4da2-a9f6-8928a8fc1f4d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011973 Dec 15 14:08:06.885525 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:06.898814 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-f217c460-0fee-460c-8014-33b44967c509 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.906712 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-f217c460-0fee-460c-8014-33b44967c509 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011419 Dec 15 14:08:06.907236 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:08:06.918979 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-32a4be62-37e6-4393-8449-13202be10a48 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.927521 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-32a4be62-37e6-4393-8449-13202be10a48 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012100 Dec 15 14:08:06.928107 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:08:06.940547 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:08:06.948388 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011937 Dec 15 14:08:06.948891 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Dec 15 14:08:06 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:09:45.891522 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-1bfa08b0-dfc0-4a19-9371-49a0a52cf4ce tempest-verify_tempest_config-782359857 tempest-verify_tempest_config-782359857-project] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:09:45.893518 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-1bfa08b0-dfc0-4a19-9371-49a0a52cf4ce tempest-verify_tempest_config-782359857 tempest-verify_tempest_config-782359857-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107116 Dec 15 14:09:45.894046 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 14:09:45 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:11:14.514439 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:14.515412 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 15 14:11:14.515726 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:11:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:11:14.774477 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:14.775663 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:11:14.775663 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:11:14.777211 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:14.778206 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:14.779279 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:14.779705 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:14.813162 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-796daf7d-cf6a-4dcb-84e2-c20e861a42b2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151614 Dec 15 14:11:14.813723 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 35/71] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:11:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:11:16.317352 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:16.318340 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Dec 15 14:11:16.318727 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:11:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:11:16.511109 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:16.512835 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:11:16.512835 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:11:16.514334 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:16.514784 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:16.515574 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:16.516031 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:16.535410 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-037f06e8-3338-4c64-8d42-33e3291e871a admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075930 Dec 15 14:11:16.535968 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:11:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:11:28.473722 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:28.474715 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 15 14:11:28.475099 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:11:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:11:28.668912 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:28.670097 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:11:28.670097 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:11:28.671591 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:28.672071 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:28.672892 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:28.673314 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:28.697680 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-af3fe054-f5a4-435d-84f1-c2a6ac3fb72a admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079689 Dec 15 14:11:28.698153 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 37/75] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:11:28 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:11:30.201813 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: DEBUG nova.api.openstack.wsgi [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] Calling method '>' {{(pid=102450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:30.202817 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: INFO nova.api.openstack.requestlog [None req-353f7809-ff6c-47ec-8e67-1b6f65ef8c98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Dec 15 14:11:30.203215 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: [pid: 102450|app: 0|req: 39/76] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 14:11:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:11:30.397076 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:11:30.398231 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:11:30.398231 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Dec 15 14:11:30.399800 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:30.400274 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:30.401131 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:11:30.401561 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:11:30.423783 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-f6476046-9660-4c21-89c4-7de748ff7705 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078370 Dec 15 14:11:30.424363 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 38/77] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 14:11:30 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:12:27.544232 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: Wed Dec 15 14:12:27 2021 - graceful shutdown triggered... Dec 15 14:12:27.544736 dv-cinder-813229-4-iscsi devstack@n-api.service[102450]: Gracefully killing worker 2 (pid: 102450)... Dec 15 14:12:27.544360 dv-cinder-813229-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 14:12:27.545531 dv-cinder-813229-4-iscsi devstack@n-api.service[102449]: Gracefully killing worker 1 (pid: 102449)... Dec 15 14:12:28.545380 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: worker 1 buried after 1 seconds Dec 15 14:12:28.545895 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: worker 2 buried after 1 seconds Dec 15 14:12:28.545895 dv-cinder-813229-4-iscsi devstack@n-api.service[102448]: goodbye to uWSGI. Dec 15 14:12:28.546976 dv-cinder-813229-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 14:12:28.547525 dv-cinder-813229-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 14:12:28.550343 dv-cinder-813229-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 14:12:28.559376 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 14:12:28.562111 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 14:12:28 2021] *** Dec 15 14:12:28.562272 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 14:12:28.562408 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 14:12:28.562526 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: nodename: dv-cinder-813229-4-iscsi Dec 15 14:12:28.562638 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: machine: x86_64 Dec 15 14:12:28.562757 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: clock source: unix Dec 15 14:12:28.562874 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: pcre jit disabled Dec 15 14:12:28.562985 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: detected number of CPU cores: 4 Dec 15 14:12:28.563096 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: current working directory: / Dec 15 14:12:28.563216 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: detected binary path: /usr/bin/uwsgi-core Dec 15 14:12:28.563335 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: your processes number limit is 47680 Dec 15 14:12:28.563447 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: your memory page size is 4096 bytes Dec 15 14:12:28.563566 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: detected max file descriptor number: 2048 Dec 15 14:12:28.563679 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: lock engine: pthread robust mutexes Dec 15 14:12:28.563984 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: thunder lock: enabled Dec 15 14:12:28.564298 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 14:12:28.564512 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 14:12:28.610723 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: Python main interpreter initialized at 0x55d20dc699c0 Dec 15 14:12:28.610723 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: python threads support enabled Dec 15 14:12:28.610723 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: your server socket listen backlog is limited to 100 connections Dec 15 14:12:28.610723 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: your mercy for graceful operations on workers is 90 seconds Dec 15 14:12:28.611165 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 14:12:28.611165 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: *** Operational MODE: preforking *** Dec 15 14:12:28.611458 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: *** uWSGI is running in multiple interpreter mode *** Dec 15 14:12:28.611458 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: spawned uWSGI master process (pid: 116658) Dec 15 14:12:28.611665 dv-cinder-813229-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 14:12:28.612282 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: spawned uWSGI worker 1 (pid: 116680, cores: 1) Dec 15 14:12:28.612646 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: spawned uWSGI worker 2 (pid: 116681, cores: 1) Dec 15 14:12:28.612799 dv-cinder-813229-4-iscsi devstack@n-api.service[116658]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 14:12:30.536752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:12:30.536752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: from cryptography.utils import int_from_bytes Dec 15 14:12:30.537484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:12:30.537484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: from cryptography.utils import int_from_bytes Dec 15 14:12:30.537959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:12:30.537959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: from cryptography.utils import int_from_bytes Dec 15 14:12:30.538099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 14:12:30.538099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: from cryptography.utils import int_from_bytes Dec 15 14:12:32.987753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:12:32.988482 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:12:32.988583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:12:32.988872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:12:32.989130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:12:32.989524 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.989851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.990177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.990498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.990830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.991146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.991475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.991799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.992157 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.992424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.992767 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.993099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-4-iscsi {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.993426 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.993736 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.994049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.994372 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.994680 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.995004 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.995312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.995810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.996268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.996580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.996893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.997241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.997565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.997882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.998204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.998518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.998846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.999160 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.999573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-4-iscsi {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:32.999898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.000251 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.000573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.000993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.001311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.001625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.001950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.002278 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.002593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.003089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.003425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.003802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.004210 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.004463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.004779 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.005296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.005627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.005942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.006263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.006518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.006831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.007162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.007491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.007820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.008102 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.011554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012694 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.012883 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.013201 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.013531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.013938 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.014195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.014512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.014859 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.015184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.015500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.015828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.016181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.016499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.016816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.017131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.017459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.017794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.018111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.018272 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 14:12:33.018700 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.018776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 14:12:33.018855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.018943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.019042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 14:12:33.019276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.019459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 14:12:33.019616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 14:12:33.019796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.019982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.020894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.021961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022263 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022417 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.022878 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023023 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023177 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023510 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-4-iscsi {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.023841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.024183 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.025423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.025423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.025738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.025738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.025738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.026945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.027873 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028070 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028614 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.028917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.029850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030453 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030615 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.030910 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031055 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-4-iscsi {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031212 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.031892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032100 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032547 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032836 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.032992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033600 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.033905 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034060 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034666 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.034819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.035417 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.035580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.035726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.035726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.036032 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.036179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.036324 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.036467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.036621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.036777 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.037007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.037162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.037306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.037456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.037600 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.037743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.037895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.038040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.038182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.038411 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.038571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.038743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.038898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.039042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.039189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.039332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.039332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.039651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.039804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.040118 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.040279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.040433 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.040592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.040766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.040911 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.041054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.041208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.041359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.041359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.041649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.041794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.041936 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.042078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.042301 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.042457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.042614 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.042775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.042927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.043079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.043223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.043223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.043585 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.043731 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.043873 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.044115 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.044270 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.044421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.044573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.044573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.044858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.044858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.045597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.045764 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.045920 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.046072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.046224 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.046376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.046533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.046679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.046830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.046984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.047138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.047282 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.047437 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.047589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.047734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.047994 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.048156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.048310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.048541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.048699 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.048851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.049003 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.049148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.049317 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.049462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.049615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.049776 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.049925 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.050076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.050229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.050382 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.050620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.050792 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.050948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.051094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.051254 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.051421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.051567 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.051567 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.051847 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.052026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.052180 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.052333 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.052477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.052627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.052782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.052939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.053094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.053326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.053478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.053630 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.053781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.053938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.054083 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.054237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.054388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.054532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.054675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.054826 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.054977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.055127 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.055653 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.055894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.056110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.056271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.056427 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.056585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.056738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.056889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.057041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.057202 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.057349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.057501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.057652 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.057817 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.057980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.057980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.058268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.058413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.058588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.058588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.059059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.059059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.059342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.059342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.059624 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.059777 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.059980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.060146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.060300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.060459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.060616 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.060772 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.060923 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.061075 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.061220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.061376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.061528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.061672 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.061833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.061978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.062129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.062288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.062440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.062585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.062736 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.062891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.063042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.063195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.063340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.063483 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.063635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.063790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.063961 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.064368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.064524 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.064669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.064822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.064966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.065123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.065276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.065774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.065943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.066189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.066341 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 14:12:33.066512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.066658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.066811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.066964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067109 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067252 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.067914 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068428 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068724 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.068961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069427 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.069876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070499 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070663 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.070808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.071518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.071723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.071878 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.072896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.073950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074096 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074405 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074710 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.074855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.075289 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.075442 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.075982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.076139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.076407 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.076567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.076720 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.076865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077016 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.077933 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078383 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.078835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079554 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.079842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080006 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080781 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.080925 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081088 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.081980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082267 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.082858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083743 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.083888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084066 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084663 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.084967 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.085111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.085256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.085418 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.085564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.086053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.086293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.086650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.087375 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.087574 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.087731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.087877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.088939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.089937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090080 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.090853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091329 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091481 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091971 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.091971 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.092284 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.092445 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.092603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.092773 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.092927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093091 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093716 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.093867 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094189 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094497 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094648 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.094977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.095136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.095295 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.095454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.095613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.095794 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.096305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.096468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.096649 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.096901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.097066 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.097247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.097660 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.097812 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.097971 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.098888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.099040 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.099190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.099418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.099673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.099839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100521 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.100980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.101969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.102662 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.102882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103187 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103347 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103497 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.103816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104665 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.104980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105765 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.105924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.106467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.106630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.106791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107075 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107241 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.107861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108220 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108372 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108683 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.108833 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.109858 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110016 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110319 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110482 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.110942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.111123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.111277 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.111485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.111641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.114463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.114677 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.114844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115014 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115172 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115651 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.115902 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.116163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.116755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.116920 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.117092 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.117362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.117521 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.117690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.118413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.118583 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.118744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.118895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119098 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119582 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119732 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.119901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.120180 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.120348 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.120577 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.120749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.120903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.121968 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.122128 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.122920 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123240 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123409 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.123894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124488 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.124962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125262 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125585 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.125898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.126056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.126215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.126386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.126940 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.127102 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.127260 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.127532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.127703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.127857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128660 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.128991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129302 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.129946 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.130976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131308 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.131957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132436 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.132902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.133876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134354 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.134914 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135081 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135244 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135693 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.135851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.136052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.136216 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.136369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.136533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.137082 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.137243 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.137401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.137578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.137854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138172 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138330 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.138967 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139280 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139590 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.139946 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140257 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.140843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141155 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.141937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142269 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.142892 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143547 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.143859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.144854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145172 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145324 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145482 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145645 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.145968 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.146777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.147438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.147600 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.147752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148043 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148374 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148689 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.148841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.149041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.149300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.149535 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.149714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.149868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150020 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150331 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150503 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150742 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.150928 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151091 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151720 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.151882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152722 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.152883 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.153993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154158 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154310 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154469 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.154939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155260 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155410 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.155884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.156211 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.156379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.156531 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.156682 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.156832 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.157010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.157557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.157731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.157893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158353 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158353 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158664 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.158983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159134 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159596 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.159945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160118 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160284 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160602 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.160934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.161247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.161412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.161571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.161730 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.161890 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162219 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162379 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162538 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.162851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163486 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.163817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.164112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.164301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.164301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.164301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.165255 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.165255 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.165543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.165779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.165943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.166888 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.167041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.167192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.167687 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.167849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168059 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.168968 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169121 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169284 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.169917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170379 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.170851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171019 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.171991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172474 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.172955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.173935 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174327 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174483 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174807 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.174961 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175430 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175762 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.175916 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.176904 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.177066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.177226 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.177378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.177378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.177933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178030 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178648 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.178955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179177 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179257 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179338 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179499 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179876 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.179876 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.180041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.180120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.180207 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.180339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.180427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181032 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.181964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182134 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182683 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.182988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183128 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183202 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183341 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183488 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.183863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184873 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.184961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185040 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185118 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185343 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185554 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185701 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.185931 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186147 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.186749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187084 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187418 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.187586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188103 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188174 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188174 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188174 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188458 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188529 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188687 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188832 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.188902 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189240 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189467 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189619 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189697 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189840 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.189918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190091 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190171 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.190949 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191030 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191857 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.191977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192097 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192320 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192616 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192773 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.192925 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193243 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193628 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193701 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.193941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194663 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194827 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194911 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.194984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195204 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.195986 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.196227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.196536 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.196628 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.196862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.196964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.197175 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.197268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.197486 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.197581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198337 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198697 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.198800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199624 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199763 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.199967 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200260 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200365 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200664 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.200968 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.201966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202197 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202505 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.202824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203343 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203444 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.203755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204121 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204628 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.204938 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205031 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205345 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.205989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206310 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206792 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.206913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.207108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.207352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.207486 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.207680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.207816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208481 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208725 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.208958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209502 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.209932 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.210917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.211048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.211231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.211354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.211586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.211908 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212202 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.212957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213266 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.213909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214107 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.214899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215151 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215428 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215610 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215733 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.215973 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216583 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216719 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.216893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.217955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.218451 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.218592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.218709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.218837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.218961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219075 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219187 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.219802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.220151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.220481 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.220704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.220827 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.221816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222131 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222633 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222762 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222886 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.222999 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223620 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.223981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224126 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.224864 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.225823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226002 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226444 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226662 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.226973 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.227814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.227978 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.228191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.228686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.228822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.228955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229567 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.229899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230204 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230398 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.230924 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231375 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231554 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.231860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.232027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.232335 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.232516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.232680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.232841 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233335 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233815 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.233969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.234919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235544 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.235876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236092 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.236875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237188 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237513 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.237990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.238141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.238301 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.238860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239489 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239659 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.239822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.240848 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:12:33.241008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241579 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241579 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.241877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.242385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.242711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.245199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.245561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.245912 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.246229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.246546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.246860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.247189 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.247505 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.247820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.248165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.248479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.249041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.249212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.249397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.249706 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.250018 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.250334 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.250674 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.251154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.251476 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.251793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.252136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.252540 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.252760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.253071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.253382 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.253698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.254028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.254344 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.254653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.255081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.255396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.255717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.260233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.265822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.267316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.272963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_db.sqlalchemy.engines [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.274909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.280609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.281181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.281181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.281181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.281181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 14:12:33.281181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 14:12:33.301013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_db.sqlalchemy.engines [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.337294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.context [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5558468a-fedb-47cf-8f35-4b962b2baa9f(cell1) {{(pid=116680) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:12:33.341635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.343427 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.344300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.346311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.360273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_db.sqlalchemy.engines [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.363054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_db.sqlalchemy.engines [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.377841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.context [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5558468a-fedb-47cf-8f35-4b962b2baa9f(cell1) {{(pid=116681) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 14:12:33.382284 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.384139 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.384959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:12:33.386933 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:12:33.399976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_db.sqlalchemy.engines [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.400957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_db.sqlalchemy.engines [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.530795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_db.sqlalchemy.engines [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.564684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_db.sqlalchemy.engines [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 14:12:33.861843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: WARNING keystonemiddleware.auth_token [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:12:33.869868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: WARNING keystonemiddleware.auth_token [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:12:33.894119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: WARNING keystonemiddleware.auth_token [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:12:33.901144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: WARNING keystonemiddleware.auth_token [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:12:34.224037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: WARNING keystonemiddleware.auth_token [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:12:34.230472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: WARNING keystonemiddleware.auth_token [None req-98772cbe-41a3-4d1f-b17d-49122676d34e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:12:34.235830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d20dc699c0 pid: 116680 (default app) Dec 15 14:12:34.244696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: WARNING keystonemiddleware.auth_token [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 14:12:34.249926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: WARNING keystonemiddleware.auth_token [None req-0ed2d1e5-e506-4182-9b8c-a7ca1e28f569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 14:12:34.255264 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d20dc699c0 pid: 116681 (default app) Dec 15 14:13:10.056728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7bee6261-f4b6-4e97-bc10-66f01bce4945 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Action: 'create', calling method: .version_select at 0x7f9cc08cae50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1319807538", "metadata": {"Type": "work"}}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:10.060576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7bee6261-f4b6-4e97-bc10-66f01bce4945 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:10.063383 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7bee6261-f4b6-4e97-bc10-66f01bce4945 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.899958 Dec 15 14:13:10.066023 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 14:13:08 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1904 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:13:10.079448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e3229f44-343d-4d9f-9414-ab2754c7ae53 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Action: 'create', calling method: .version_select at 0x7f9cc08669d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2101240135", "metadata": {"Type": "work"}}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:10.083483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e3229f44-343d-4d9f-9414-ab2754c7ae53 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:10.088438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e3229f44-343d-4d9f-9414-ab2754c7ae53 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014134 Dec 15 14:13:10.089304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 14:13:10 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:13:10.098944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3a9ea832-4807-40c3-b449-62674b4d9adb tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Action: 'create', calling method: .version_select at 0x7f9cc0866940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1648193794", "metadata": {"Type": "work"}}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:10.100924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3a9ea832-4807-40c3-b449-62674b4d9adb tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:10.110960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3a9ea832-4807-40c3-b449-62674b4d9adb tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015870 Dec 15 14:13:10.132040 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 14:13:10 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:13:10.147001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7dd26832-71d4-4b26-85f8-2b3749781177 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Calling method '.version_select at 0x7f9cc080a430>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:10.267624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8ead8a4c-605d-4fef-8139-7d1fa79c287a tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Action: 'create', calling method: .version_select at 0x7f9cc08bbee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-186983893"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:10.749404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-7dd26832-71d4-4b26-85f8-2b3749781177 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] HTTP exception thrown: Volume tempest-invalid-316326654 could not be found. Dec 15 14:13:10.749404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7dd26832-71d4-4b26-85f8-2b3749781177 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 404 to user: Volume tempest-invalid-316326654 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:10.749404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7dd26832-71d4-4b26-85f8-2b3749781177 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-316326654" status: 404 len: 98 microversion: 2.1 time: 0.614769 Dec 15 14:13:10.751045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1214 bytes} [Wed Dec 15 14:13:10 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-316326654 => generated 98 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 14:13:10.772235 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-defee3ed-5847-4a5b-ac15-d0e8c075c210 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005354 Dec 15 14:13:10.772235 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 5/5] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Dec 15 14:13:10 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 15 14:13:10.783662 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8674bd24-1283-4552-9b36-2bea4add9c8b tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006092 Dec 15 14:13:10.785265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 6/6] 10.222.0.36 () {58 vars in 1136 bytes} [Wed Dec 15 14:13:10 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 14:13:10.798436 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9f0a2ff2-ab43-4da9-a289-015fd85d92b5 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Calling method '.version_select at 0x7f9cc07a4f70>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:11.123794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-9f0a2ff2-ab43-4da9-a289-015fd85d92b5 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] HTTP exception thrown: Volume a0a87d3a-5d99-4f73-afef-832e45d34410 could not be found. Dec 15 14:13:11.124982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9f0a2ff2-ab43-4da9-a289-015fd85d92b5 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 404 to user: Volume a0a87d3a-5d99-4f73-afef-832e45d34410 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:11.125815 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9f0a2ff2-ab43-4da9-a289-015fd85d92b5 tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/a0a87d3a-5d99-4f73-afef-832e45d34410" status: 404 len: 109 microversion: 2.1 time: 0.334563 Dec 15 14:13:11.126642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 7/7] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:13:10 2021] DELETE /compute/v2.1/os-volumes/a0a87d3a-5d99-4f73-afef-832e45d34410 => generated 109 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:11.135796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-43a4d0ea-2bc6-4a02-b227-db4a4ed4b94a tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Calling method '.version_select at 0x7f9cc07a4b80>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:12.282816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-43a4d0ea-2bc6-4a02-b227-db4a4ed4b94a tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] HTTP exception thrown: Volume 8947f802-343e-456f-a5db-a8f0f5c0f18a could not be found. Dec 15 14:13:12.283415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-43a4d0ea-2bc6-4a02-b227-db4a4ed4b94a tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] Returning 404 to user: Volume 8947f802-343e-456f-a5db-a8f0f5c0f18a could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:12.284241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-43a4d0ea-2bc6-4a02-b227-db4a4ed4b94a tempest-VolumesNegativeTest-1284642324 tempest-VolumesNegativeTest-1284642324-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8947f802-343e-456f-a5db-a8f0f5c0f18a" status: 404 len: 109 microversion: 2.1 time: 1.152706 Dec 15 14:13:12.288297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 8/8] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:11 2021] GET /compute/v2.1/os-volumes/8947f802-343e-456f-a5db-a8f0f5c0f18a => generated 109 bytes in 1154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:12.364637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8ead8a4c-605d-4fef-8139-7d1fa79c287a tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.823581 Dec 15 14:13:12.365347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 1/9] 10.222.0.36 () {60 vars in 1154 bytes} [Wed Dec 15 14:13:08 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 14:13:12.377682 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cb35ca58-d287-4e28-adc0-4b550556e054 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073af70>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:12.522915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cb35ca58-d287-4e28-adc0-4b550556e054 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 200 len: 344 microversion: 2.1 time: 0.149326 Dec 15 14:13:12.524754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 9/10] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:12 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:13.537988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e831a578-5ccf-4b4d-a323-a275a145e78b tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc079fa60>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:13.706116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e831a578-5ccf-4b4d-a323-a275a145e78b tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 200 len: 344 microversion: 2.1 time: 0.173999 Dec 15 14:13:13.707307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 2/11] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:13 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:13.721657 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1897889280", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "4c509f7c-96ea-41ce-b3fd-f7b95c265247"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:13.937474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] validate_networks() for [('4c509f7c-96ea-41ce-b3fd-f7b95c265247', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:13:14.721749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-478e2565-60d5-4dc4-bde7-68b146bcc3c8 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc079fdc0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:14.827907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-478e2565-60d5-4dc4-bde7-68b146bcc3c8 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 200 len: 345 microversion: 2.1 time: 0.105263 Dec 15 14:13:14.832542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 3/12] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:14 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:14.845064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fe375a89-6ae3-4219-ae91-6dba427b9a40 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Action: 'create', calling method: .version_select at 0x7f9cc07af430>, body: {"snapshot": {"volume_id": "06296f11-2071-4d4f-a61f-096cba697ec3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1685836461"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:15.443555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:13:15.444656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:13:15.445272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:13:15.445964 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:13:15.446770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:13:15.480286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.480286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:15.480286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:15.480286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:15.638201 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Getting quotas for project dfffb0b60ded44389f1a092fbfbac8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:15.649301 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fe375a89-6ae3-4219-ae91-6dba427b9a40 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.808342 Dec 15 14:13:15.655898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 4/13] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Dec 15 14:13:14 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:15.661183 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5e120832-2aa7-4670-a21b-50a227bd1333 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073b040>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:15.682516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Getting quotas for user da99a6228318495b8a430ea37f41076a and project dfffb0b60ded44389f1a092fbfbac8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:15.731369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:13:15.738977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:13:15.795210 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5e120832-2aa7-4670-a21b-50a227bd1333 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 287 microversion: 2.1 time: 0.137839 Dec 15 14:13:15.796464 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 5/14] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:15 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:15.807637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-80f9b323-b17d-4f12-9845-34889c33e6bf tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc079fe50>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:15.937534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-80f9b323-b17d-4f12-9845-34889c33e6bf tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.134682 Dec 15 14:13:15.939144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 6/15] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Dec 15 14:13:15 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:15.949943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f9512863-9fbc-4024-9ed1-15fc36887d73 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073baf0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:16.012691 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f9512863-9fbc-4024-9ed1-15fc36887d73 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 287 microversion: 2.1 time: 0.067421 Dec 15 14:13:16.013257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:15 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:16.024556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9c72b428-67e7-45fd-8634-e0fe7acb376c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480444 Dec 15 14:13:16.025492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 10/17] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:13:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:13:16.035540 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-16f3730d-d8e8-4749-9729-daeb6976d67b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:16.036717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-16f3730d-d8e8-4749-9729-daeb6976d67b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:16.249884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-16f3730d-d8e8-4749-9729-daeb6976d67b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:16.284095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-16f3730d-d8e8-4749-9729-daeb6976d67b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1215 microversion: 2.1 time: 0.252042 Dec 15 14:13:16.304767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 8/18] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:16 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:17.025795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c8ceeee2-7218-4851-8a2a-29c396cf4e68 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073e040>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:17.132388 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c8ceeee2-7218-4851-8a2a-29c396cf4e68 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 287 microversion: 2.1 time: 0.111428 Dec 15 14:13:17.138526 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 9/19] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:17 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:17.508601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5cecc347-0623-4838-9a5d-645c9c503f62 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:17.508601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5cecc347-0623-4838-9a5d-645c9c503f62 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:17.508601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5cecc347-0623-4838-9a5d-645c9c503f62 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:17.527868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5cecc347-0623-4838-9a5d-645c9c503f62 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1215 microversion: 2.1 time: 0.229814 Dec 15 14:13:17.531805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 10/20] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:17 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:17.578740 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: .version_select at 0x7f9cbfe36430>, body: {"keypair": {"name": "tempest-keypair-1319654944"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:17.642899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:17.656960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:18.067365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:18.072295 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:18.090072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-aa699298-a4b7-4c43-93e7-65587ced0b12 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.122441 Dec 15 14:13:18.092915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 11/21] 10.222.0.36 () {62 vars in 1198 bytes} [Wed Dec 15 14:13:16 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1126 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:13:18.146619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4b6a2e25-54ad-4b86-9c2c-8233c2eba2d3 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073b4c0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:18.193888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4b6a2e25-54ad-4b86-9c2c-8233c2eba2d3 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 287 microversion: 2.1 time: 0.052402 Dec 15 14:13:18.194426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:18 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:18.554710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-26ba3bcd-c712-41e6-b351-e99ba5ff48fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:18.555874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-26ba3bcd-c712-41e6-b351-e99ba5ff48fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:18.819614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-26ba3bcd-c712-41e6-b351-e99ba5ff48fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:18.876269 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-26ba3bcd-c712-41e6-b351-e99ba5ff48fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1215 microversion: 2.1 time: 0.323736 Dec 15 14:13:18.892597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:18 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:19.209713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-88c22cdb-345d-470e-8c97-ad4a18755e97 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc0706550>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:19.277008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-88c22cdb-345d-470e-8c97-ad4a18755e97 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 288 microversion: 2.1 time: 0.074491 Dec 15 14:13:19.278298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:19 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:19.287632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-aa2650dd-28b1-4fa7-8077-9f7868643509 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cbfe71f70>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:19.501271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-aa2650dd-28b1-4fa7-8077-9f7868643509 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 202 len: 0 microversion: 2.1 time: 0.217336 Dec 15 14:13:19.501943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Dec 15 14:13:19 2021] DELETE /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:13:19.515627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-64751322-a4cf-4d1a-9f49-f46304528c67 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc0706dc0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:19.630820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-64751322-a4cf-4d1a-9f49-f46304528c67 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 200 len: 287 microversion: 2.1 time: 0.114625 Dec 15 14:13:19.630820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:19 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:19.898189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:19.899268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:19.908777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:19.909511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:19.911000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:19.913933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:20.098057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:20.116708 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-309a4ff6-c6c5-42a8-a96d-0838f6a69c31 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1219 microversion: 2.1 time: 0.222039 Dec 15 14:13:20.117991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:19 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1219 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:20.568697 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: .version_select at 0x7f9cc111c670>, body: {"keypair": {"name": "tempest-keypair-768295738"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:20.640954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b0031fc9-1fea-4e1c-84b8-4b4e99df5447 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cbed8c9d0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:20.643439 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:20.669153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:20.684421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-b0031fc9-1fea-4e1c-84b8-4b4e99df5447 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] HTTP exception thrown: Snapshot f78b1893-abaf-4124-8084-1b3a82ea0aa4 could not be found. Dec 15 14:13:20.685076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b0031fc9-1fea-4e1c-84b8-4b4e99df5447 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Returning 404 to user: Snapshot f78b1893-abaf-4124-8084-1b3a82ea0aa4 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:20.685837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b0031fc9-1fea-4e1c-84b8-4b4e99df5447 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4" status: 404 len: 111 microversion: 2.1 time: 0.049304 Dec 15 14:13:20.686590 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:13:20 2021] GET /compute/v2.1/os-snapshots/f78b1893-abaf-4124-8084-1b3a82ea0aa4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:20.696755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5d0717e1-6e5c-4ccb-9eb7-951c32865535 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc073ad30>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:20.981703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5d0717e1-6e5c-4ccb-9eb7-951c32865535 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 202 len: 0 microversion: 2.1 time: 0.289919 Dec 15 14:13:20.983209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:13:20 2021] DELETE /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:13:20.991892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4dcc2aa4-2d92-4a59-a5d3-0da5d3249acf tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cbed8c670>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:21.123863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4dcc2aa4-2d92-4a59-a5d3-0da5d3249acf tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 200 len: 344 microversion: 2.1 time: 0.136177 Dec 15 14:13:21.129231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:20 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:21.134313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:21.135091 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:21.147744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.155085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:21.155085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:21.155085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:21.285618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:21.297130 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:21.320883 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-08ced5b7-3843-4205-93d1-2c79d58ce676 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.082804 Dec 15 14:13:21.329879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 14/31] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 14:13:20 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:21.671605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:21.689713 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-192e6551-a027-47f1-8fa8-1b436bf839fc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1267 microversion: 2.1 time: 0.554875 Dec 15 14:13:21.719324 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:21 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1267 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:22.140380 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3bdbf780-806c-472e-8836-d400d15c9f2d tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc06ddca0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:22.203037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-3bdbf780-806c-472e-8836-d400d15c9f2d tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] HTTP exception thrown: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. Dec 15 14:13:22.204081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3bdbf780-806c-472e-8836-d400d15c9f2d tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Returning 404 to user: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:22.204930 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3bdbf780-806c-472e-8836-d400d15c9f2d tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 404 len: 109 microversion: 2.1 time: 0.070101 Dec 15 14:13:22.205801 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:22 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:22.224989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-174a8db1-bfbb-485a-be47-1d155a5cb6c4 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cbedae280>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:22.286781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-174a8db1-bfbb-485a-be47-1d155a5cb6c4 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] HTTP exception thrown: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. Dec 15 14:13:22.287492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-174a8db1-bfbb-485a-be47-1d155a5cb6c4 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Returning 404 to user: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:22.288768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-174a8db1-bfbb-485a-be47-1d155a5cb6c4 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 404 len: 109 microversion: 2.1 time: 0.069834 Dec 15 14:13:22.289589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:13:22 2021] DELETE /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:22.300553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb63e56b-e0ae-41e4-8d90-e4e9385a3b70 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Calling method '.version_select at 0x7f9cc111c4c0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:22.364068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-eb63e56b-e0ae-41e4-8d90-e4e9385a3b70 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] HTTP exception thrown: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. Dec 15 14:13:22.365926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb63e56b-e0ae-41e4-8d90-e4e9385a3b70 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] Returning 404 to user: Volume 06296f11-2071-4d4f-a61f-096cba697ec3 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:13:22.366884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eb63e56b-e0ae-41e4-8d90-e4e9385a3b70 tempest-VolumesSnapshotsTestJSON-354380619 tempest-VolumesSnapshotsTestJSON-354380619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3" status: 404 len: 109 microversion: 2.1 time: 0.071871 Dec 15 14:13:22.370745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 16/35] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:13:22 2021] GET /compute/v2.1/os-volumes/06296f11-2071-4d4f-a61f-096cba697ec3 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:13:22.732499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:22.733247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:22.747855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:22.752132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:22.755341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:22.757074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:23.398826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:23.411812 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-88675662-c9df-44dc-b01f-7b1dacabafd9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1273 microversion: 2.1 time: 0.685011 Dec 15 14:13:23.415179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:22 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1273 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:24.435329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:24.435997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:24.466216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:24.472963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:24.475895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:24.478139 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:25.107617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:25.150886 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93c0161b-b495-4037-8a11-917c61e2746d tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1273 microversion: 2.1 time: 0.721343 Dec 15 14:13:25.168946 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 17/37] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:24 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1273 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:26.069058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-504330695", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1398e422-6eb7-4c67-a7ee-d619fb1f02c3"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:26.171915 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:26.194294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:26.194294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.194294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.194294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:26.195718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:26.214702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] validate_networks() for [('1398e422-6eb7-4c67-a7ee-d619fb1f02c3', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:13:26.494847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:26.507891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0f795854-4bbe-4227-b43d-84d2b3116f88 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1273 microversion: 2.1 time: 0.341110 Dec 15 14:13:26.508953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:26 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:27.527657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:27.529268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:27.544517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:27.545259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:27.551558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:27.553150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.239743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.250631 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b8028b7c-2c88-4db5-a461-6bd28ad7bc4c tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.727201 Dec 15 14:13:28.266713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 19/39] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:27 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:28.270190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:13:28.270190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:13:28.270769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:13:28.271102 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:13:28.271793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:13:28.295869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.298968 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.303380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:28.304256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:28.357549 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Getting quotas for project 685aa5d5bc754913a5ca3dd5518e129e. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:28.375275 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Getting quotas for user 0118e016021f4e3eb4f0d0e59fe54488 and project 685aa5d5bc754913a5ca3dd5518e129e. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:28.407837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:13:28.416785 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:13:28.684614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-47f7f905-1c74-46d9-b9d7-8b82d63625d2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.163433 Dec 15 14:13:28.691675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:13:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:13:28.701485 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-cde7d1be-894c-4ffd-8e53-0e8f50402248 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:28.702950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-cde7d1be-894c-4ffd-8e53-0e8f50402248 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:28.871058 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-cde7d1be-894c-4ffd-8e53-0e8f50402248 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:28.892612 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-cde7d1be-894c-4ffd-8e53-0e8f50402248 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1221 microversion: 2.1 time: 0.198946 Dec 15 14:13:28.924543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 20/41] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:28 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:29.274627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:29.275369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:29.288014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.288014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:29.288014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:29.288014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:29.472547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:29.485035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3a5af7ea-4e6a-404d-b677-28102500f3a8 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.215081 Dec 15 14:13:29.499474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 22/42] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:29 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:29.786863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-790008733", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87207a00-487c-41ca-9a1a-60e78eea9937"}], "security_groups": [{"name": "tempest-securitygroup--44550576"}], "key_name": "tempest-keypair-1319654944", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:30.098676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-125057373", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1398e422-6eb7-4c67-a7ee-d619fb1f02c3"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:30.216857 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] validate_networks() for [('1398e422-6eb7-4c67-a7ee-d619fb1f02c3', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:13:30.508745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] validate_networks() for [('87207a00-487c-41ca-9a1a-60e78eea9937', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:13:31.543356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:13:31.543950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:13:31.544789 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:13:31.545403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:13:31.546002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:13:31.564388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.564844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.569878 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:31.570522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:31.628552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Getting quotas for project 685aa5d5bc754913a5ca3dd5518e129e. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:31.638138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Getting quotas for user 0118e016021f4e3eb4f0d0e59fe54488 and project 685aa5d5bc754913a5ca3dd5518e129e. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:31.669560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:13:31.672079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:13:31.857562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-af6f3844-1a21-4869-bdfa-24b4e1314781 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.772386 Dec 15 14:13:31.862893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 23/43] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:13:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:13:31.872339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-349426643", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de3ac665-6e2b-47fc-8d80-1b730042a6ab"}], "security_groups": [{"name": "tempest-securitygroup--1997998472"}], "key_name": "tempest-keypair-768295738", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:32.216434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] validate_networks() for [('de3ac665-6e2b-47fc-8d80-1b730042a6ab', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:13:33.222552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:13:33.224561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:13:33.225562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:13:33.226238 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:13:33.227051 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:13:33.261258 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.307061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.307061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.307061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.324768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:33.340758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:33.359747 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:13:33.363880 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:13:33.559494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:13:33.560027 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:13:33.560492 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:13:33.560942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:13:33.561334 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:13:33.570444 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.571154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.572390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.573013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.606426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:13:33.610906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:13:33.622655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:13:33.625910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:13:33.717737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-94df1f64-e3b6-49af-9a7d-ea998d5e208f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.853477 Dec 15 14:13:33.718988 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 24/44] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:13:31 2021] POST /compute/v2.1/servers => generated 402 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:13:33.755678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:33.759270 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:33.769341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.770190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.771237 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.772045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.939106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6b2d42eb-0811-4c20-b58d-e9e41c2435b4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.145887 Dec 15 14:13:33.939106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 21/45] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Dec 15 14:13:29 2021] POST /compute/v2.1/servers => generated 400 bytes in 4149 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 14:13:33.939106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:33.939106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:33.968561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.983828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:33.985701 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:33.986332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.032230 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.041618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a4815ab4-0c28-41ee-a21b-711bad3172c9 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.321326 Dec 15 14:13:34.051981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 25/46] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:33 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:34.230589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.241551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8aa2c44e-5b54-42fc-9405-52d65fac6737 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1225 microversion: 2.1 time: 0.307511 Dec 15 14:13:34.243024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 22/47] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:33 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1225 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:34.254880 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ee6b63bb-6921-4009-8b15-55dd5a3c0b0b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:34.255508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ee6b63bb-6921-4009-8b15-55dd5a3c0b0b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:34.343747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ee6b63bb-6921-4009-8b15-55dd5a3c0b0b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.353635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ee6b63bb-6921-4009-8b15-55dd5a3c0b0b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1236 microversion: 2.1 time: 0.106039 Dec 15 14:13:34.356598 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 23/48] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:34 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:34.373312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:34.374153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:34.471887 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.503297 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.513807 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:34.518023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f1d0197a-bedb-4ee9-8097-061ed9797be4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1281 microversion: 2.20 time: 0.157617 Dec 15 14:13:34.518977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:34 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:34.574344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-9b33a279-7fc7-4d25-984f-60502d3662ad req-02ff2e47-92bd-4343-a890-224ba30dbd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca00d83-fb1f-455b-bf15-01eebb989bb8", "tag": "e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:34.590676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:34.590676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:34.643843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-9b33a279-7fc7-4d25-984f-60502d3662ad req-02ff2e47-92bd-4343-a890-224ba30dbd97 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.646323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-9b33a279-7fc7-4d25-984f-60502d3662ad req-02ff2e47-92bd-4343-a890-224ba30dbd97 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.740509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-9b33a279-7fc7-4d25-984f-60502d3662ad req-02ff2e47-92bd-4343-a890-224ba30dbd97 service nova] Creating event network-changed:e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d for instance aca00d83-fb1f-455b-bf15-01eebb989bb8 on hv-cinder-81322 Dec 15 14:13:34.741124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-9b33a279-7fc7-4d25-984f-60502d3662ad req-02ff2e47-92bd-4343-a890-224ba30dbd97 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 14:13:34.742553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.745419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.746439 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:34.747090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:34.769102 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.compute.rpcapi [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 14:13:34.771079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=116680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 14:13:34.813539 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6c3325e1-84de-47f9-a959-e9ada55304d9 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.759853 Dec 15 14:13:34.814741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 26/50] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:35.060190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.063472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.072690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.073214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.074246 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.074917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.262630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.263438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.293975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.295586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.304144 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.306249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.324458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.334730 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-881aad91-7d1c-4986-b6c9-7f6ee2a58131 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.279102 Dec 15 14:13:35.335312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 25/51] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:35.375820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-74cfec77-5b96-47fe-8b52-f361975db27a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.376568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-74cfec77-5b96-47fe-8b52-f361975db27a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.444632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.465454 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2a87666e-9f1e-4432-9107-c1a77c366804 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1217 microversion: 2.1 time: 0.198658 Dec 15 14:13:35.465454 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:35.485930 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-74cfec77-5b96-47fe-8b52-f361975db27a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.494467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-74cfec77-5b96-47fe-8b52-f361975db27a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1236 microversion: 2.1 time: 0.122155 Dec 15 14:13:35.497336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 26/53] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:35.537103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:35.538585 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:35.550435 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.553515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.556670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:35.559509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:35.730498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.752543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.757010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:35.760252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-53fdcfe3-3424-4142-9c61-31510c95951b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1285 microversion: 2.20 time: 0.227340 Dec 15 14:13:35.763149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 28/54] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:35 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:36.354304 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:36.354304 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:36.361026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.361478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.362322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.362895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.472359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:36.473269 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:36.489312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.497168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.497168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.498586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.644973 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.653776 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d8feef0e-f35c-436d-9300-fd05aa1df164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1273 microversion: 2.1 time: 0.185476 Dec 15 14:13:36.654369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 29/55] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:36 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:36.667678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:36.668425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:36.683209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.683993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.684951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.685656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.868215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:36.881389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4fcdf1b1-f11a-43ca-a773-cfba5e4d23ec tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1240 microversion: 2.1 time: 0.222390 Dec 15 14:13:36.890192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 30/56] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:36 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1240 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:36.894805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:36.902195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:36.925896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.926351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:36.927150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:36.927604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.043344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.051149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.055511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.060395 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3da5f74f-72f2-4876-80f2-ea567c6c9689 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.711564 Dec 15 14:13:37.064652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 27/57] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:36 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:37.067380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.068300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8e71600d-6a0a-47c0-8b9c-793349a19447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1277 microversion: 2.20 time: 0.179952 Dec 15 14:13:37.078903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 31/58] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:36 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:37.671557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:37.672914 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:37.703546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.705927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.708136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.714321 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.843053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:37.887202 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ba36bb91-099f-4cf2-a7a6-bda6b6b0edce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1279 microversion: 2.1 time: 0.214262 Dec 15 14:13:37.909687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:37.910484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:37.917373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:37 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:37.924587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.928146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:37.930400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:37.931097 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.055054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.062528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e4ad017a-9488-4cd3-847e-472690d63cbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1288 microversion: 2.1 time: 0.157499 Dec 15 14:13:38.083992 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:38.084861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:38.098184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 32/60] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:37 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:38.109195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:38.110119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:38.116350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.117264 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.118125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.119133 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.119913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.130412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.131624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.131899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.454358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.465294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.467038 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.468427 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a35cd48e-8a6d-4d65-afb6-75de13c77766 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1351 microversion: 2.20 time: 0.368693 Dec 15 14:13:38.469582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 33/61] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:38 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1351 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:38.692677 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:38.703559 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-561450a9-2fa5-4222-bb30-7cb7bdebb9bd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.625051 Dec 15 14:13:38.713952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 29/62] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:38 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:38.909760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:38.910346 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:38.922415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.922871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:38.923670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:38.924142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.047064 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:39.056869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8d289ae2-3288-48ba-94f5-6b7693f10f86 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1279 microversion: 2.1 time: 0.150974 Dec 15 14:13:39.057460 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:38 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:39.090317 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:39.100870 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:39.125624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.126275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.127156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.127595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.195435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:39.202800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-787e6dbd-a82b-4141-a359-36a531945dfc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1294 microversion: 2.1 time: 0.123385 Dec 15 14:13:39.203495 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 30/64] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:39 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:39.488492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:39.489182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:39.505536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.505988 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.506856 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.507484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.721151 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:39.721765 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:39.728705 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.729406 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:39.730566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:39.731300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.013502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.025536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.028808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.030709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d9b87f23-7b50-4cd5-84b2-81bfad495f59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.547115 Dec 15 14:13:40.042868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 35/65] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:39 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:40.074425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:40.084353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:40.084353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.084353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.084353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.084830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.480989 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.493968 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3670f567-2e9a-4d8f-9eae-78f3cbdc99d2 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.776700 Dec 15 14:13:40.497885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 31/66] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:39 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:40.522116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:40.522829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:40.539584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.540425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.541419 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:40.542033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:40.830758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:40.844293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2324f943-0038-4daa-91c4-4d4764b8321c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.774213 Dec 15 14:13:40.847560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 36/67] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:40 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:41.040538 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-68ab9d90-e860-4220-8fed-556b0685ab18 req-c9647490-c5df-4858-b883-55f68b131091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0055c3fd-c364-425b-a659-292f94e6f09c", "tag": "f550a9d9-c3b2-49c2-8bfc-1d263e506ae0"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:41.042674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:41.042674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:41.055984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-68ab9d90-e860-4220-8fed-556b0685ab18 req-c9647490-c5df-4858-b883-55f68b131091 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.063417 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-68ab9d90-e860-4220-8fed-556b0685ab18 req-c9647490-c5df-4858-b883-55f68b131091 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.102974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-68ab9d90-e860-4220-8fed-556b0685ab18 req-c9647490-c5df-4858-b883-55f68b131091 service nova] Creating event network-changed:f550a9d9-c3b2-49c2-8bfc-1d263e506ae0 for instance 0055c3fd-c364-425b-a659-292f94e6f09c on hv-cinder-81322 Dec 15 14:13:41.119741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-68ab9d90-e860-4220-8fed-556b0685ab18 req-c9647490-c5df-4858-b883-55f68b131091 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082599 Dec 15 14:13:41.121360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 37/68] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:41.136388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:41.137399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:41.154403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.154572 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.155276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.156426 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.158035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.171131 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6cae361e-a447-4015-9e6e-2496f753fc75 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.669878 Dec 15 14:13:41.186235 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 32/69] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:40 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:41.520114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:41.520734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:41.526945 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.527385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.528240 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.528681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.882419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.896096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.899831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:41.901587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a9fe51fb-13f6-4b3f-b091-5f71d18f9077 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.773467 Dec 15 14:13:41.902699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 38/70] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:41 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:41.909675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:41.910461 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:41.932706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.935942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:41.938277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:41.962536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:42.279680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:42.294508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-856796e6-0d37-4f56-98ae-fefe839b3f00 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.776152 Dec 15 14:13:42.295445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 33/71] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:41 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:42.897665 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:42.909460 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-343c5c46-de30-4825-a8c5-1545a106fde3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 1.004523 Dec 15 14:13:42.910452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 39/72] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:41 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:42.917798 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:42.918633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:42.929086 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.930483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:42.931365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:42.931810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.036324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-87aafe14-5aea-4fdd-ba68-e411162c3345 req-3de0a25a-6cf8-4a6d-a28b-53773712b692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:43.039708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:43.039708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:13:43.078066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-87aafe14-5aea-4fdd-ba68-e411162c3345 req-3de0a25a-6cf8-4a6d-a28b-53773712b692 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.087647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-87aafe14-5aea-4fdd-ba68-e411162c3345 req-3de0a25a-6cf8-4a6d-a28b-53773712b692 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.134126 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-87aafe14-5aea-4fdd-ba68-e411162c3345 req-3de0a25a-6cf8-4a6d-a28b-53773712b692 service nova] Creating event network-changed:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:13:43.134789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-87aafe14-5aea-4fdd-ba68-e411162c3345 req-3de0a25a-6cf8-4a6d-a28b-53773712b692 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 14:13:43.136324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.137006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.137938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.138466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.155783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.compute.rpcapi [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 14:13:43.156946 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] Releasing lock "compute-rpcapi-router" {{(pid=116681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 14:13:43.188349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c628705c-c912-49d4-95b3-6f8eb92d4526 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.890944 Dec 15 14:13:43.189778 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 34/73] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:43.195208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:43.196269 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:43.203225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.203943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.204894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.205569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.360404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.367672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4fc46efc-873b-4499-ae90-12ec6219e285 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.455459 Dec 15 14:13:43.368281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 40/74] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:42 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:43.372654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-207e12e4-2b28-4f5a-8ad2-7364ad020037 req-1d1faeb0-79c3-4cc5-ba9d-5799587478a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f88386-a08e-43b7-9832-f7932c369cd9", "tag": "ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:43.374253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:43.374253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:43.381258 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-207e12e4-2b28-4f5a-8ad2-7364ad020037 req-1d1faeb0-79c3-4cc5-ba9d-5799587478a5 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.381795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-207e12e4-2b28-4f5a-8ad2-7364ad020037 req-1d1faeb0-79c3-4cc5-ba9d-5799587478a5 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.392688 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-207e12e4-2b28-4f5a-8ad2-7364ad020037 req-1d1faeb0-79c3-4cc5-ba9d-5799587478a5 service nova] Creating event network-changed:ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529 for instance f8f88386-a08e-43b7-9832-f7932c369cd9 on hv-cinder-81322 Dec 15 14:13:43.400587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-207e12e4-2b28-4f5a-8ad2-7364ad020037 req-1d1faeb0-79c3-4cc5-ba9d-5799587478a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031061 Dec 15 14:13:43.401831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 41/75] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:43.436775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.449245 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.451303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.452713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c5bbdf9f-249d-45d0-8f7e-acba112a52af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.261697 Dec 15 14:13:43.453431 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 35/76] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:43 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:43.458013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:43.458746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:43.465383 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.466045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.466843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.467287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.583545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-45c2ef8c-2c68-4dcf-81d1-05165d9f15fe req-278f5163-3648-41da-bbb3-ba41a9d17280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca00d83-fb1f-455b-bf15-01eebb989bb8", "name": "network-vif-plugged", "status": "completed", "tag": "e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:43.585525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:43.585525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:43.593818 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-45c2ef8c-2c68-4dcf-81d1-05165d9f15fe req-278f5163-3648-41da-bbb3-ba41a9d17280 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.594251 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-45c2ef8c-2c68-4dcf-81d1-05165d9f15fe req-278f5163-3648-41da-bbb3-ba41a9d17280 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.607113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-45c2ef8c-2c68-4dcf-81d1-05165d9f15fe req-278f5163-3648-41da-bbb3-ba41a9d17280 service nova] Creating event network-vif-plugged:e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d for instance aca00d83-fb1f-455b-bf15-01eebb989bb8 on hv-cinder-81322 Dec 15 14:13:43.612062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-45c2ef8c-2c68-4dcf-81d1-05165d9f15fe req-278f5163-3648-41da-bbb3-ba41a9d17280 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208910 Dec 15 14:13:43.613012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 42/77] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:43.625107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:43.632695 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-94fde68c-afc2-46fb-902e-8722103fd74b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.178019 Dec 15 14:13:43.633190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 36/78] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:43 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:43.929570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:43.930441 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:43.936551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.936997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:43.937768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:43.938204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.075150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.082841 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ad81891a-16e5-4bcf-b1e6-a46cbe460774 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.157307 Dec 15 14:13:44.084025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 43/79] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:43 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:44.384861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:44.385399 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:44.391074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.391529 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.392327 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.392757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.471979 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:44.472982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:44.482103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.484458 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.485256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.487674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.586984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.594932 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-11b3a39c-96e0-45fc-bc9f-a22be1d9ca6d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.214257 Dec 15 14:13:44.595555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 37/80] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:44 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:44.654902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:44.655528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:44.661316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.665358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.666287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.667751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:44.668443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:44.674842 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.676614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.677782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d9fd1803-0882-4738-a200-d7a10d34f645 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.209867 Dec 15 14:13:44.678345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 44/81] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:44 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:13:44.816672 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:44.824463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1d9748b4-064d-422a-bda1-ec87c0848162 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.177783 Dec 15 14:13:44.825033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 38/82] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:44 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:45.104808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.105436 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.111604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.112580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.113507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.114231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.225780 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5ddcb2bc-91ac-4113-99c3-4abd33271c13 req-b278c995-16d2-436b-be37-fe66886c27b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef62bed0-b1e8-4769-878e-4dc0bbb2c15f", "tag": "7fbad533-96b2-474b-aa8f-d92f5601bf21"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:45.227998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:45.227998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:13:45.235330 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5ddcb2bc-91ac-4113-99c3-4abd33271c13 req-b278c995-16d2-436b-be37-fe66886c27b9 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.235992 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5ddcb2bc-91ac-4113-99c3-4abd33271c13 req-b278c995-16d2-436b-be37-fe66886c27b9 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.247602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5ddcb2bc-91ac-4113-99c3-4abd33271c13 req-b278c995-16d2-436b-be37-fe66886c27b9 service nova] Creating event network-changed:7fbad533-96b2-474b-aa8f-d92f5601bf21 for instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f on hv-cinder-81322 Dec 15 14:13:45.252994 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5ddcb2bc-91ac-4113-99c3-4abd33271c13 req-b278c995-16d2-436b-be37-fe66886c27b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030977 Dec 15 14:13:45.253791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 39/83] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:45.256759 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.265014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b5b929fd-d9c4-497f-8f0e-8ff9ea5f792e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.167498 Dec 15 14:13:45.265665 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 45/84] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:45.613491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.614403 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.621127 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.621580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.622383 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.622815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.700185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.700718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.707656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.708142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.708925 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.709403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.820600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.836612 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-259a0da6-ee74-4201-8228-94ff1963b873 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.227239 Dec 15 14:13:45.847442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 40/85] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:45.853223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:45.853852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:45.861652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.862389 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.863435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:45.864054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:45.893076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.906765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.924453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:45.926568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f6d76f36-0142-468d-ac34-30d990cbce51 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.230524 Dec 15 14:13:45.927566 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 46/86] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:13:46.284364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:46.285780 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:46.295879 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.296380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.299471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.300123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.325270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.335638 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-46b8534f-3b75-4151-b883-3ad41e2d0acd tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.486077 Dec 15 14:13:46.337134 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 41/87] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:45 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:46.709235 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:46.720728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f21e8299-3e30-463a-8334-72e0d98f4aa4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.440804 Dec 15 14:13:46.721974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 47/88] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:46 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:46.855120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:46.855976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:46.866064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.867451 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.879507 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.879507 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.951045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:46.952090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:46.963069 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.965884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:46.968205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:46.970563 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.437823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.445733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bca9675c-9ea7-455f-be0d-e05e464a2745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.595506 Dec 15 14:13:47.446550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 42/89] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:46 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:47.456540 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:47.457385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:47.466668 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.478271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.481447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.482933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e9f3167c-6770-4e3a-9ba8-7ba8b2c126d3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.537148 Dec 15 14:13:47.483771 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.484127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 48/90] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:46 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:47.496017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.496017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.496017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.739104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:47.739711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:47.746574 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.747010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.747790 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:47.748272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:47.870257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:47.881219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-df39ebc6-8cd7-44ca-884b-ee1b7b402e0e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.433416 Dec 15 14:13:47.883806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 43/91] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:47 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:48.047365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.059447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e7b335a4-a4dd-4711-9b8c-628bddff3874 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.324642 Dec 15 14:13:48.060132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 49/92] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:47 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:48.468171 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:48.469713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:48.483965 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.484527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.486932 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.487456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.503189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:48.503884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:48.515140 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.527311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.528355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.539793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.819615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.828668 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3fa3a2f0-4213-421e-835a-d961117d7a8a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.368561 Dec 15 14:13:48.833133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 44/93] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:48 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:48.843917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.855025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.860464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:48.865846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cfdb9c23-f8ab-46f7-a755-99123a417210 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.362334 Dec 15 14:13:48.865846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 50/94] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:48 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:48.901227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:48.902690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:48.910683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.911337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:48.912305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:48.912913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.078094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:49.078834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:49.085958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.086605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.087529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.088221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.123076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.130885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e281f9e2-7b44-4e58-8633-7a2c0cea1ed1 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1315 microversion: 2.1 time: 0.235988 Dec 15 14:13:49.134565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 45/95] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:48 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:49.363304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:49.371637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-acb9b835-3aa8-4722-8efa-52c69bac7487 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.298759 Dec 15 14:13:49.372447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 51/96] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:49 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:49.852837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:49.853797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:49.862319 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.865958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.865958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.865958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.879443 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:49.880566 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:49.888115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.892504 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:49.894872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:49.896391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.070866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.083844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1c43e7f4-2eea-4199-a91e-fba589a8840d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.236639 Dec 15 14:13:50.084734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 46/97] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:49 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:50.117941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.125922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.127461 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.128570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-189fed51-de21-4111-8618-b135952f3a89 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.252910 Dec 15 14:13:50.129124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 52/98] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:49 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:13:50.148882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:50.149515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:50.155336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.155809 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.156608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.157039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.329325 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.338322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-59f9c71f-8c57-45cd-a66d-6848fb86e7be tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1503 microversion: 2.1 time: 0.193254 Dec 15 14:13:50.339425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 47/99] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:50 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:50.437803 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:50.438887 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:50.448493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.451223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.452321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.452912 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.637613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:50.662555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9427ae74-9753-484c-9dbe-3174bf3cdf3d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.228777 Dec 15 14:13:50.672706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 53/100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:50 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:50.927555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-d18b47c0-79f9-4349-b579-f6ec9c77396e req-6793049e-ad8a-4367-974e-e67ced2c22bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "name": "network-vif-plugged", "status": "completed", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:50.931320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:50.931320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:13:50.943624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-d18b47c0-79f9-4349-b579-f6ec9c77396e req-6793049e-ad8a-4367-974e-e67ced2c22bf service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:50.944357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-d18b47c0-79f9-4349-b579-f6ec9c77396e req-6793049e-ad8a-4367-974e-e67ced2c22bf service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:50.960129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-d18b47c0-79f9-4349-b579-f6ec9c77396e req-6793049e-ad8a-4367-974e-e67ced2c22bf service nova] Creating event network-vif-plugged:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:13:50.967231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-d18b47c0-79f9-4349-b579-f6ec9c77396e req-6793049e-ad8a-4367-974e-e67ced2c22bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047271 Dec 15 14:13:50.968461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 48/101] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:51.102359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:51.102974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:51.108894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.109561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.111338 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.111952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.148803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:51.149942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:51.157458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.158125 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.159103 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.159682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.322449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.329863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b9aac674-88f8-40fe-a7c5-42a3c0544af0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.231958 Dec 15 14:13:51.330633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 54/102] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:51 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:51.487487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.504751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.509408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.512357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-df0f38b2-0e14-4439-9e2f-9a182b35312e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.366616 Dec 15 14:13:51.512357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 49/103] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:51 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:13:51.681516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:51.682148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:51.688283 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.688951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.689954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:51.690766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:51.929561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:51.929561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-96d80b9c-cb09-4362-8d36-77a11b82c5bf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.242581 Dec 15 14:13:51.929561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 55/104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:51 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:52.299231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea48283e-6f7a-4f2e-968c-e067a7632c4f"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:52.301380 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:52.308604 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.309522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.310817 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.311474 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.346863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:52.347561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:52.353937 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.355603 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.356504 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.358584 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.539145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.546943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c7c771b5-e09d-4517-bbfd-7a83f4a825f6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.203919 Dec 15 14:13:52.547762 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 56/105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:52 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:52.552642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:52.553246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:52.559554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.560040 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.565473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.565473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.713684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.722815 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.724751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:52.725942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5a65bdcf-4bf3-4d84-9e42-481b5d7e4006 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1405 microversion: 2.20 time: 0.177007 Dec 15 14:13:52.726623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 57/106] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:52 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:52.944339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:52.945637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:52.951261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.955895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:52.955895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:52.955895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.089775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.098546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-266e8191-d5dc-4e4e-a34b-c1249c07e687 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.157886 Dec 15 14:13:53.099393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 58/107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:52 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:53.104182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-534cf81e-31af-4ed8-a09b-8eea5cd13603 req-011ac3db-94d9-405b-9542-f119368fbc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055c3fd-c364-425b-a659-292f94e6f09c", "name": "network-vif-plugged", "status": "completed", "tag": "f550a9d9-c3b2-49c2-8bfc-1d263e506ae0"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:53.105832 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:53.105832 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:53.112619 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-534cf81e-31af-4ed8-a09b-8eea5cd13603 req-011ac3db-94d9-405b-9542-f119368fbc4f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.113065 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-534cf81e-31af-4ed8-a09b-8eea5cd13603 req-011ac3db-94d9-405b-9542-f119368fbc4f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.125261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-534cf81e-31af-4ed8-a09b-8eea5cd13603 req-011ac3db-94d9-405b-9542-f119368fbc4f service nova] Creating event network-vif-plugged:f550a9d9-c3b2-49c2-8bfc-1d263e506ae0 for instance 0055c3fd-c364-425b-a659-292f94e6f09c on hv-cinder-81322 Dec 15 14:13:53.130173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-534cf81e-31af-4ed8-a09b-8eea5cd13603 req-011ac3db-94d9-405b-9542-f119368fbc4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029696 Dec 15 14:13:53.130757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 59/108] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:53.564598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:53.565294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:53.571527 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.572007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.572797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.573314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.712635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.720826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2c21aaaa-8481-4f7b-9c90-544ee446e727 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.160212 Dec 15 14:13:53.721449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 60/109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:53 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:53.744917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:53.747714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:53.751900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.752384 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.753419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.753850 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.892150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.900855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.902393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:53.903566 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f60a58be-6d1f-4c59-9441-ae2f10e6fe09 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1597 microversion: 2.20 time: 0.163032 Dec 15 14:13:53.904187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 61/110] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:13:53 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:13:53.922507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:53.922994 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:53.928765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.929293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:53.930009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:53.930439 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.055205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2fe5c567-ef9e-4764-bdff-ec56ec5e0317 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132501 Dec 15 14:13:54.055205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 62/111] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Dec 15 14:13:53 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:13:54.086045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-695e18dd-5dbf-48bf-be48-86acfc5f2862 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "POST /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.789754 Dec 15 14:13:54.086754 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 50/112] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:13:52 2021] POST /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8/os-volume_attachments => generated 194 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:54.119241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:54.124982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:54.128145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.128987 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.130015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.130637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.481874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:54.496204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cef6419d-2f60-461d-8df1-8669e1defa5a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.384539 Dec 15 14:13:54.497150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 63/113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:54 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:54.741800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:54.743022 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:54.752709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.753177 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:54.753979 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:54.754565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.134108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.143367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e207a1c8-f7b6-4c41-9a95-b46a729aab83 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.407608 Dec 15 14:13:55.144300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 51/114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:54 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:55.159977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef62bed0-b1e8-4769-878e-4dc0bbb2c15f", "name": "network-vif-plugged", "status": "completed", "tag": "7fbad533-96b2-474b-aa8f-d92f5601bf21"}, {"server_uuid": "f8f88386-a08e-43b7-9832-f7932c369cd9", "name": "network-vif-plugged", "status": "completed", "tag": "ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:55.161844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:55.161844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:13:55.171134 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:55.171568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.185154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] Creating event network-vif-plugged:7fbad533-96b2-474b-aa8f-d92f5601bf21 for instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f on hv-cinder-81322 Dec 15 14:13:55.185659 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] Creating event network-vif-plugged:ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529 for instance f8f88386-a08e-43b7-9832-f7932c369cd9 on hv-cinder-81322 Dec 15 14:13:55.191844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-c8f2f61c-a079-4bb6-bff5-d0a6092f50d5 req-40accbb3-7a0a-4b63-bb52-0920503b7721 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036062 Dec 15 14:13:55.192542 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 64/115] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:55 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:55.538943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:55.538943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:55.538943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:55.538943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.541216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:55.547081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:55.858102 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:55.867136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a56e409a-9198-49ad-83c1-7d595b959f03 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.355590 Dec 15 14:13:55.868587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 52/116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:55 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:56.061495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:56.063521 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:56.065673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-9aaf9c70-0e85-4570-97b9-480a69a71be3 req-9198cd22-074e-48c2-8aa3-39046eeb053a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:56.067415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:13:56.067415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:13:56.076601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-9aaf9c70-0e85-4570-97b9-480a69a71be3 req-9198cd22-074e-48c2-8aa3-39046eeb053a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.077038 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-9aaf9c70-0e85-4570-97b9-480a69a71be3 req-9198cd22-074e-48c2-8aa3-39046eeb053a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.079045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.081851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.084846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.085402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.090428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-9aaf9c70-0e85-4570-97b9-480a69a71be3 req-9198cd22-074e-48c2-8aa3-39046eeb053a service nova] Creating event network-changed:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:13:56.095855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-9aaf9c70-0e85-4570-97b9-480a69a71be3 req-9198cd22-074e-48c2-8aa3-39046eeb053a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Dec 15 14:13:56.096658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 53/117] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:13:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:13:56.165437 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:56.171608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:56.184588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.185288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.186372 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.186795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.236249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4c126131-0008-4bc4-9d15-e10f0499d2dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.178783 Dec 15 14:13:56.236891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 65/118] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:13:56 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:56.389765 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:56.399072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3439d308-6d8e-4ed0-89e9-ce293d8458e6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.240394 Dec 15 14:13:56.399768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 54/119] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:56 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:56.894613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:56.900019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:56.909795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.910407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:56.911475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:56.912044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.189221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:57.202809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e4cc92f8-4872-4cf7-a97e-7cfda2e1c1cf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.321139 Dec 15 14:13:57.223302 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 66/120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:56 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:57.248586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:57.253284 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:57.260726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.261312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.262223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.264938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.357056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-efe07295-3a2c-48ad-a204-ba8d5de564e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.112795 Dec 15 14:13:57.362186 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 55/121] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:13:57 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:57.417359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:57.418413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:57.424541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.425438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.426239 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:57.426827 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:57.653011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:57.662468 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4b7fa3cd-f7e6-433f-88a3-29e7b120bba8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1362 microversion: 2.1 time: 0.250923 Dec 15 14:13:57.663050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 67/122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:57 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:58.220888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:58.224274 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:58.229930 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.230372 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.231141 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.231568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.372510 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.376139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:58.380855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b6d33989-6e0d-4a6f-8d3e-673ef2dc45a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1321 microversion: 2.1 time: 0.164008 Dec 15 14:13:58.381726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 56/123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:58 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:58.393399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:58.404806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.407580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.407580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.407580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.480700 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cef6feea-147c-4f7e-9a39-84b52a2c9c44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.115176 Dec 15 14:13:58.481442 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 68/124] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:13:58 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:58.681269 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:58.682093 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:58.689883 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.690502 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.691459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.692096 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.858273 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:58.865842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eb610809-ccb5-47ac-8726-e3beb78f50ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1547 microversion: 2.1 time: 0.188741 Dec 15 14:13:58.867146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 57/125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:58 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:58.895453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:58.896048 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:58.903562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.904028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:58.905088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:58.905525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.021032 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f3d01e7b-96ac-451c-99fb-3a8b581eb306 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132385 Dec 15 14:13:59.022209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 69/126] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Dec 15 14:13:58 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:13:59.398907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:13:59.400290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:59.406908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.407496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.408381 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.408889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.494061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:59.494981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:59.502949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.503387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.504989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.505443 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.557747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:13:59.566816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-44ed14f8-b894-4ed9-93b7-4219bbfbae91 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1516 microversion: 2.1 time: 0.172222 Dec 15 14:13:59.567483 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 58/127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:13:59 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:13:59.585943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc4c100c-68ab-46ca-a31e-2b7fe2ec4dcd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.097288 Dec 15 14:13:59.586726 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 70/128] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:13:59 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:13:59.586853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:13:59.588111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:13:59.596054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.597079 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.598606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:13:59.600064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:13:59.636339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lazy-loading 'flavor' on Instance uuid f8f88386-a08e-43b7-9832-f7932c369cd9 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:14:00.127277 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-69455669-5907-408e-a970-a2b5cd13b973 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9/action" status: 200 len: 32 microversion: 2.1 time: 0.545335 Dec 15 14:14:00.127901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 59/129] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:13:59 2021] POST /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9/action => generated 32 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:00.137958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:00.138791 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:00.156405 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.156923 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.157786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.158294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.332766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:00.338869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b761080f-f4b9-47ea-8ae9-98b36b2e766b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.205269 Dec 15 14:14:00.342508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 71/130] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:00 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:00.597711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:00.599604 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:00.615636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.618185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.619114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.620457 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.687545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:00.689173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:00.697523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.698017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.698995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.699550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.708175 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6fff0dcb-f5c3-4b1b-b6c6-923883a254ea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.114633 Dec 15 14:14:00.709112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 60/131] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:00 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:00.714787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-4fff4531-0d23-460e-be31-54aa2d6a9a0b req-ff0562d1-0a29-4a27-a989-1eb10eca864d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef62bed0-b1e8-4769-878e-4dc0bbb2c15f", "tag": "7fbad533-96b2-474b-aa8f-d92f5601bf21"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:00.716347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:14:00.716347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:14:00.726318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4fff4531-0d23-460e-be31-54aa2d6a9a0b req-ff0562d1-0a29-4a27-a989-1eb10eca864d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:00.726985 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4fff4531-0d23-460e-be31-54aa2d6a9a0b req-ff0562d1-0a29-4a27-a989-1eb10eca864d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:00.739147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-4fff4531-0d23-460e-be31-54aa2d6a9a0b req-ff0562d1-0a29-4a27-a989-1eb10eca864d service nova] Creating event network-changed:7fbad533-96b2-474b-aa8f-d92f5601bf21 for instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f on hv-cinder-81322 Dec 15 14:14:00.744862 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-4fff4531-0d23-460e-be31-54aa2d6a9a0b req-ff0562d1-0a29-4a27-a989-1eb10eca864d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Dec 15 14:14:00.746291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 61/132] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:14:00.818319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3d698ed1-3caf-4e19-888d-b360eff38175 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.134326 Dec 15 14:14:00.819834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 72/133] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:00 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:01.359594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:01.360790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:01.380366 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.381214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.382226 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.387769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.692494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:01.699339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e3b0ffc6-0153-4f66-8b1c-6e9031cd7333 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.344196 Dec 15 14:14:01.710448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 62/134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:01 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:01.719274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:01.720962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:01.730178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.730789 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.735289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.735289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.830851 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:01.831852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:01.841274 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.841591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f6765a23-51e8-4347-b671-8bc44810e154 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.126016 Dec 15 14:14:01.843124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 73/135] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:01 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:01.843248 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.844791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:01.845305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:01.932532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a58118c4-f35c-4849-9ffe-20d4705a918d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.105355 Dec 15 14:14:01.933445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 63/136] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:01 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:02.718391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:02.719209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:02.728693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.729848 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.730894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.731328 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.854670 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:02.856353 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:02.863237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.863686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.864502 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.865065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.868696 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:02.876102 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e6ce291b-e8ea-4163-903c-6ff508b07d8c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.162705 Dec 15 14:14:02.876666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 74/137] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:02 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:02.931512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-46baad9a-f43e-4fe9-962c-1bc6ba484d0e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.081255 Dec 15 14:14:02.933690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 64/138] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:02 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:02.942695 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:02.943802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:02.950839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.951368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:02.952250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:02.952750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.043802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f59d5cfb-383f-43fd-b95a-bfb06ace7c07 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.104829 Dec 15 14:14:03.044993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 75/139] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:02 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:03.895655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:03.896413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:03.904235 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.904729 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.905744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.906471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.944417 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:03.946163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:03.953313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.953751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:03.954529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:03.954959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.029957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d1b774a0-b7eb-450d-be54-720fdc3f5b2e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.089469 Dec 15 14:14:04.030579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 76/140] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:03 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:04.051406 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.059241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:04.059378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6d36f507-e40e-4884-9d85-f929f330172d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.168959 Dec 15 14:14:04.059983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 65/141] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:03 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:04.060573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:04.069228 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.069706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.071052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.071487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.164903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5fe93792-0f9f-4990-804a-7d7d074c4177 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.109756 Dec 15 14:14:04.165542 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 77/142] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:04 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:04.371576 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:04.373563 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:04.387392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.387880 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.388702 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.389181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.416040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Going to try to terminate instance {{(pid=116681) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:14:04.698994 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1274874c-eb0c-4267-a382-0562b84dede6 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 204 len: 0 microversion: 2.1 time: 0.333980 Dec 15 14:14:04.699944 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 66/143] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:14:04 2021] DELETE /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:14:04.709160 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:04.709862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:04.717058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.717629 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.718406 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:04.718845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:04.864566 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:04.873186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7e68c700-cc91-40e4-94f5-2518c8f1cc5e tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1555 microversion: 2.1 time: 0.167430 Dec 15 14:14:04.873186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 78/144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:04 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:05.042072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:05.043061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.049267 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.049720 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.050524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.050959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.076697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:05.077312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.083626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.084104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.084874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.085299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.126527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0a0b7405-70c0-4873-b360-98ff97600413 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 0.089096 Dec 15 14:14:05.127222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 67/145] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:05 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:05.176230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:05.177212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.184468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.184913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.185711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.186138 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.229178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:05.236590 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cb09ca8f-889c-448c-add0-81972eca5fd7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.163649 Dec 15 14:14:05.237151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 79/146] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:05 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:05.259728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-40259050-0f4b-4b87-99e0-3a062aadd772 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.087512 Dec 15 14:14:05.260402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 68/147] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:05 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:05.889579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:05.890107 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:05.896451 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.897013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:05.897779 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:05.898294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.081655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:06.089588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6918d997-8de6-49ca-835d-b5d4e6a586bc tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1555 microversion: 2.1 time: 0.203720 Dec 15 14:14:06.090163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 80/148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:05 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:06.137957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:06.138937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:06.145868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.146258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.147028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.147463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.252351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:06.253022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:06.258957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.259401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.260273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.260707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.396974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:06.405104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c57c5f83-10f7-4189-9eb1-a156b40ba5e0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.156340 Dec 15 14:14:06.405696 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 81/149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:06 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:06.409996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:06.410930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:06.417565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.417997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:06.418779 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:06.419206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.616067 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-88739538-980e-4c65-bcbd-f290d7b49945 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 14 microversion: 2.20 time: 2.482045 Dec 15 14:14:08.620082 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 69/150] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:06 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 14 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:08.622449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:08.623173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:08.630805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.631258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.632078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.632644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.635029 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f00c49f9-fcf5-42b6-b8a8-46cabd640f09 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 2.228101 Dec 15 14:14:08.636641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 82/151] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:06 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:08.641665 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:08.642356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:08.650630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.659612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.660649 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:08.661115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:08.858085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.862947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:08.866580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1dd9c57c-c18d-41ec-ab45-16dd43486c0a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1555 microversion: 2.1 time: 0.248019 Dec 15 14:14:08.867712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 70/152] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:08 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:08.872616 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-de669ed0-d421-4b29-ac6f-a1816c21b8cb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.234716 Dec 15 14:14:08.873242 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 83/153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:08 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:09.627544 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:09.628654 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:09.636705 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.637160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.637961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.638396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.645588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:09.646497 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:09.656223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.656223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:09.656223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:09.656223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.143577 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-98f5b23c-2283-4f67-b004-1f295f4db056 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 2.501365 Dec 15 14:14:12.144329 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 84/154] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:09 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:12.149645 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:12.150334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:12.157077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.157515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.158279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.158704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.189619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-de3e9761-c2df-4cf8-a339-7ac9322a9eea tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 12124 microversion: 2.20 time: 2.565518 Dec 15 14:14:12.190299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 71/155] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:09 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 12124 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:12.195270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:12.196092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:12.203376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.203829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.204738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:12.205063 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:12.327419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.336580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9dc2e6ab-5220-4c29-bfa7-4ecf81fdea3b tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1555 microversion: 2.1 time: 0.190159 Dec 15 14:14:12.337233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 85/156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:12 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:12.387164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:12.394437 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93b09fd4-f8fd-4e58-8f8c-87432c0854bd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.203051 Dec 15 14:14:12.395025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 72/157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:12 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:13.154453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:13.155407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:13.161587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.162022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:13.162780 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.163203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:13.201675 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:13.202605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:13.209165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.209613 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:13.210404 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:13.210882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.824047 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-09540b8a-1ba8-47ba-a143-4a66e35b639a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 18915 microversion: 2.20 time: 2.625643 Dec 15 14:14:15.825561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 73/158] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:13 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 18915 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:15.827393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f5bfd854-4cae-48f7-b380-8960216c79d3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 2.676441 Dec 15 14:14:15.830633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 86/159] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:13 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:15.830875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:15.831746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:15.835917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:15.836805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:15.839227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.839678 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.840749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.841285 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.843366 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.843872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:15.844714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:15.845286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.178761 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.184530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:16.186344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bfa3501d-d870-4f25-a1eb-b19de722a164 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.354582 Dec 15 14:14:16.187400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 87/160] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:15 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:16.201899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-56a4b6ff-e134-4b32-8e20-f72b022004ae tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1555 microversion: 2.1 time: 0.375124 Dec 15 14:14:16.202562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 74/161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:15 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1555 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:16.636715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-4094d760-c6a8-468d-b6e9-90b4ab79f9c6 req-b7f91e66-8518-4d6e-8d04-fc599ebb2ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca00d83-fb1f-455b-bf15-01eebb989bb8", "name": "network-vif-deleted", "tag": "e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:16.638610 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:14:16.638610 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:14:16.650619 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4094d760-c6a8-468d-b6e9-90b4ab79f9c6 req-b7f91e66-8518-4d6e-8d04-fc599ebb2ff3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.651075 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4094d760-c6a8-468d-b6e9-90b4ab79f9c6 req-b7f91e66-8518-4d6e-8d04-fc599ebb2ff3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.661455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-4094d760-c6a8-468d-b6e9-90b4ab79f9c6 req-b7f91e66-8518-4d6e-8d04-fc599ebb2ff3 service nova] Creating event network-vif-deleted:e30d1ba0-cdc1-4895-95d2-3b1e891a5f3d for instance aca00d83-fb1f-455b-bf15-01eebb989bb8 on hv-cinder-81322 Dec 15 14:14:16.667905 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-4094d760-c6a8-468d-b6e9-90b4ab79f9c6 req-b7f91e66-8518-4d6e-8d04-fc599ebb2ff3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035528 Dec 15 14:14:16.671145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 88/162] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:14:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:14:16.837495 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:16.838410 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:16.840693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:16.842184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:16.845661 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.846108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.846895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.847340 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.848574 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.849312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.850271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:16.850874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:16.929230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-101068d8-9f3a-439a-b01e-2104fe30982e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 20210 microversion: 2.20 time: 0.095271 Dec 15 14:14:16.932281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 75/163] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:16 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 20210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:16.932846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ba985e0b-159b-4ff6-8d3d-388c9f236c38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.097665 Dec 15 14:14:16.938811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 89/164] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:16 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:17.204419 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:17.205292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.212788 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.213242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.214042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.214599 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.219835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:17.220572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.228360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.228806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.229588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.230021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.310568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da99a6228318495b8a430ea37f41076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfffb0b60ded44389f1a092fbfbac8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.320591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6c227c10-ba8a-4684-be0b-a095e0bd2164 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 200 len: 1346 microversion: 2.1 time: 0.104135 Dec 15 14:14:17.322494 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 90/165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:17 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:17.399112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:17.407240 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d7f910c2-c341-4d34-8d19-caf82033be3c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.206913 Dec 15 14:14:17.407820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 76/166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:17 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:17.942613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:17.943087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:17.943856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.943986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:17.956020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.956020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.956020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.956020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.956318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.956318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:17.956318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:17.956318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.036138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-18c19ecb-ae6e-49ad-93cd-79965ffba6e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 22029 microversion: 2.20 time: 0.097423 Dec 15 14:14:18.036789 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 91/167] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:17 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 22029 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:18.062563 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-02832a57-656e-46d0-8242-73321c52275c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 14 microversion: 2.1 time: 0.123540 Dec 15 14:14:18.065706 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 77/168] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:17 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:14:18.338185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:18.339002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:18.345896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.346344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.347120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.347552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.361464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] HTTP exception thrown: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. Dec 15 14:14:18.362060 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Returning 404 to user: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:14:18.362874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-30a59db3-1109-47c1-9651-3b57b086e4fa tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 404 len: 111 microversion: 2.1 time: 0.029471 Dec 15 14:14:18.363418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 92/169] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:18 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:14:18.425861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:18.428490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:18.434250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.434757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.435694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.436167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.469479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:18.481349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:18.487794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.488138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.488922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:18.489358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:18.504195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] HTTP exception thrown: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. Dec 15 14:14:18.505737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Returning 404 to user: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:14:18.505737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a3042dfe-b3ec-4779-9723-c63c97c71319 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040445 Dec 15 14:14:18.506420 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 93/170] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:14:18 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:14:18.642342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:18.649865 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0775f2f6-a34a-4cbd-8e5d-5f26d6682aa3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.228260 Dec 15 14:14:18.658956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 78/171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:18 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:19.047572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:19.048513 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.054695 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.055136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.055915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.056365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.074462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:19.075402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.081566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.083775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.083775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.083775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.174809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c031ab3a-f823-450b-926c-342559bc4632 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 22995 microversion: 2.20 time: 0.130712 Dec 15 14:14:19.175763 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 94/172] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:19 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 22995 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:19.203616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4be16120-1b01-4bb9-a5d0-a19a5a10677b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 6964 microversion: 2.1 time: 0.133654 Dec 15 14:14:19.204327 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 79/173] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:19 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 6964 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:19.667601 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:19.668352 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.675737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.676213 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.677355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.677785 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.859570 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:19.860257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.869189 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.869707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.870557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.870990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.885519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] HTTP exception thrown: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. Dec 15 14:14:19.886400 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Returning 404 to user: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:14:19.887231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2734b135-27e2-48e0-a7f2-aace4aa8055a tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 404 len: 111 microversion: 2.1 time: 0.032099 Dec 15 14:14:19.890797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 80/174] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:14:19 2021] DELETE /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:14:19.895900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:19.896525 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] [instance: aca00d83-fb1f-455b-bf15-01eebb989bb8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:19.904037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.904483 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.905283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:19.905922 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:19.921740 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] HTTP exception thrown: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. Dec 15 14:14:19.926148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] Returning 404 to user: Instance aca00d83-fb1f-455b-bf15-01eebb989bb8 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:14:19.926148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-15102cf6-cd27-42f1-926b-5e9077a5d734 tempest-DeleteServersTestJSON-636085715 tempest-DeleteServersTestJSON-636085715-project] 10.222.0.36 "GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8" status: 404 len: 111 microversion: 2.1 time: 0.030966 Dec 15 14:14:19.926148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 81/175] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:19 2021] GET /compute/v2.1/servers/aca00d83-fb1f-455b-bf15-01eebb989bb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:14:19.997463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:20.008253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3c4ef95b-290b-45fa-9db6-0f1a8e566f21 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.345176 Dec 15 14:14:20.008823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 95/176] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:19 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:20.186970 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:20.187878 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:20.194714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.195358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.196165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.196594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.215661 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:20.217247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:20.231535 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.232164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.233388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:20.234111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:20.298972 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-090c7efb-418a-46f2-9a5d-960dc3e83102 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 23810 microversion: 2.20 time: 0.115645 Dec 15 14:14:20.299898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 82/177] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:20 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 23810 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:20.345255 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3ec94a7e-b2a8-4ce1-8be4-5d1d115241ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 11132 microversion: 2.1 time: 0.133856 Dec 15 14:14:20.346088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 96/178] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:20 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 11132 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:21.025804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:21.026503 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:21.033396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.033847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.034667 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.035103 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.181685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:21.190687 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-afddd6cd-9417-4156-8b94-98f17c43f9ab tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.168110 Dec 15 14:14:21.191787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 83/179] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:21 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:21.312973 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:21.313960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:21.326496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.326924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.328316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.328757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.357689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:21.358600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:21.367232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.367507 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.368318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:21.368744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:21.447942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c6d5dfb4-1b31-4102-8051-0a9b7fa7f06b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 24219 microversion: 2.20 time: 0.139019 Dec 15 14:14:21.448640 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 97/180] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:21 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 24219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:21.509722 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ddba2fb5-16cf-4922-a050-8af0bf0d6ca9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 15064 microversion: 2.1 time: 0.155595 Dec 15 14:14:21.510496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 84/181] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:21 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 15064 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:22.210096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:22.211182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:22.220515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.220724 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.222336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.222797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.391245 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:22.399863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a167cffe-260e-4b84-a23c-f512dc059611 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.193992 Dec 15 14:14:22.400681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 98/182] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:22 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:22.461519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:22.462921 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:22.470830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.471287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.472176 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.472617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.521484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:22.522444 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:22.529997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.530452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.531778 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:22.532721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:22.594077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1a10a020-e9a9-4a89-af09-1297ce4edf66 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 24702 microversion: 2.20 time: 0.137636 Dec 15 14:14:22.595164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 85/183] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:22 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 24702 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:22.629248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ee66fe60-9c7a-430b-8d19-b393b3239a10 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 17250 microversion: 2.1 time: 0.109451 Dec 15 14:14:22.629248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 99/184] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:22 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 17250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:23.417279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:23.417987 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:23.425844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.425844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.426391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.426671 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.587348 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:23.594895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eb549c1c-c120-4645-896d-1823051f5471 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.181693 Dec 15 14:14:23.595528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 86/185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:23 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:23.606839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:23.607835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:23.614897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.615345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.616164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.617227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.639590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:23.642394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:23.650539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.651367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.652395 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:23.653050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:23.711710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-06b484cb-ec94-42ec-a0f8-9bf71eb6a271 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 25145 microversion: 2.20 time: 0.108732 Dec 15 14:14:23.712412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 100/186] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:23 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 25145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:23.759688 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a262eab7-8839-4932-9bd8-6c870e97615a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 17602 microversion: 2.1 time: 0.123701 Dec 15 14:14:23.760351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 87/187] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:23 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 17602 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:24.614885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:24.616130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.626749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.627768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.629181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.630119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.725160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:24.726952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.736111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.736963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.737741 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.738379 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.826064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a938ef61-db04-4ccb-8cc7-6f4772b738cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 26000 microversion: 2.20 time: 0.105834 Dec 15 14:14:24.826918 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 88/188] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:24 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 26000 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:24.831860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:24.834436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:24.839499 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:24.843853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.844561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.844832 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7f036149-ef97-4ac8-8858-c287d3afb723 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.235627 Dec 15 14:14:24.845910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:24.846549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:24.856175 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 101/189] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:24 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:24.940373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-650ed212-41d2-46a6-bf7f-8bf78399b21c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 19342 microversion: 2.1 time: 0.111232 Dec 15 14:14:24.941064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 89/190] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:24 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:25.838871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:25.840255 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:25.846851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.847528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.848533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.849088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.865059 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:25.866889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:25.876732 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.878083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.878884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.879637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.964016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-01e3fc42-2f83-47a8-8334-c77b52261be2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 26735 microversion: 2.20 time: 0.129477 Dec 15 14:14:25.964830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 102/191] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:25 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 26735 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:25.970484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:25.971469 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:25.979076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.979514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:25.980315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:25.980739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:26.028815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:26.036440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-73df38e1-11b9-4e82-be0e-7134fac8c458 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.177523 Dec 15 14:14:26.037005 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 90/192] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:25 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:26.059017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ddf49638-0fa8-4b31-9acd-ed7be97733c4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 20991 microversion: 2.1 time: 0.092371 Dec 15 14:14:26.059647 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 103/193] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:25 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 20991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:26.977464 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:26.983053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:26.984658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:26.985175 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:26.985990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:26.986417 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.054887 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:27.055490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:27.062149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.062587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.063340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.063765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.080840 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3757804c-376d-44dc-9407-e9b1a1cc9e80 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 27344 microversion: 2.20 time: 0.108677 Dec 15 14:14:27.084887 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 91/194] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:26 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 27344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:27.087605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:27.088638 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:27.096072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.096455 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.097315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:27.097724 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:27.203306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:27.211571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fc71ebea-0ea3-4cc2-b8dd-3d45c61f9a4c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.161393 Dec 15 14:14:27.212174 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 104/195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:27 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:28.101412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:28.102373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:28.109145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.109744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.110496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.111056 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.330805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93025f7b-4c1f-43de-997d-a88f01a0438d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 22250 microversion: 2.1 time: 1.247905 Dec 15 14:14:28.331971 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 92/196] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:27 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 22250 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:28.336790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:28.337581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:28.483249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.483695 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.484521 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:28.484960 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:28.618104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:28.625300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-337ea15b-66e4-4642-8289-e150261879a0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.292407 Dec 15 14:14:28.625874 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 93/197] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:28 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:29.342195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:29.343094 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:29.350566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:29.351029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:29.351808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:29.352270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:30.350022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-930821b5-abbb-47bf-9858-91e9eae26788 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 27795 microversion: 2.20 time: 2.260706 Dec 15 14:14:30.351694 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 105/198] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:28 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 27795 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:30.357234 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:30.357934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:30.364736 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:30.365182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:30.365972 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:30.366371 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:30.372315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4f256646-a53f-44ab-8ccc-8ed745686fb9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 24099 microversion: 2.1 time: 1.033584 Dec 15 14:14:30.373254 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 94/199] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:29 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 24099 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:30.499699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:30.507455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d9203d07-4735-4042-82d6-1ee37fbbb84b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.153645 Dec 15 14:14:30.508138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 106/200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:30 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:31.363049 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:31.363982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:31.371365 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.371811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.372718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.373773 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.385483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:31.386564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:31.393571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.394018 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.395361 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.395361 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.461084 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8f84b777-d6c9-45fc-a126-2d2fba2a540a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28155 microversion: 2.20 time: 0.102183 Dec 15 14:14:31.464154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 95/201] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:31 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28155 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:31.495415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-90acd74f-d480-43b7-9a56-abb297583159 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 24728 microversion: 2.1 time: 0.114271 Dec 15 14:14:31.496372 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 107/202] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:31 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 24728 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:31.529584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:31.530487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:31.538035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.539253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.539769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:31.540673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:31.714112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:31.721661 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ba27108f-a348-428f-86ee-1dc4cbcb6c8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.200263 Dec 15 14:14:31.722250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 96/203] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:31 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:32.482012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:32.483011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:32.490150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.490612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.491388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.491895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.507427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:32.508362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:32.514820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.515263 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.516141 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.516574 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.579457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a64d095b-bd26-4a27-ae0d-bae4460e1f4b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28155 microversion: 2.20 time: 0.102256 Dec 15 14:14:32.581951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 108/204] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:32 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28155 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:32.601354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93126115-45e9-4d4b-ab5b-3b0cf33922e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 25550 microversion: 2.1 time: 0.098179 Dec 15 14:14:32.602032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 97/205] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:32 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 25550 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:32.739147 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:32.739807 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:32.751969 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.752400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.753197 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:32.753653 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:32.937975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:32.945231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f91f3aeb-416b-4b55-871a-07ee2c25ba95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.210500 Dec 15 14:14:32.945797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 109/206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:32 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:33.593461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:33.594601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:33.602853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.603307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.604121 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.604559 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.615342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:33.616891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:33.623819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.624300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.625105 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.625532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.671666 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c8f8daca-b231-45d7-84a6-658286781976 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28155 microversion: 2.20 time: 0.083806 Dec 15 14:14:33.674088 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 98/207] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:33 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28155 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:33.713572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d88059f9-3996-40cd-89a8-1bf1bd74cc21 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 26373 microversion: 2.1 time: 0.101708 Dec 15 14:14:33.714874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 110/208] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:33 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 26373 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:33.963021 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:33.963707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:33.970991 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.971435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:33.972316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:33.972748 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.117798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:34.125599 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5209bb78-579d-496c-b072-205dbec479cc tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.166705 Dec 15 14:14:34.126240 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 99/209] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:33 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:34.684868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:34.686451 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:34.693373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.694028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.698024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.698643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.725696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:34.727122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:34.736256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.736820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.737797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:34.738426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:34.783847 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6b0e2102-cf30-4526-8adb-7658ac041ee6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28155 microversion: 2.20 time: 0.104503 Dec 15 14:14:34.787909 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 111/210] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:34 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28155 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:34.832325 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b3a44a4e-2d9f-4f17-860e-03335d3e8d89 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 27052 microversion: 2.1 time: 0.110389 Dec 15 14:14:34.835785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 100/211] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:34 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 27052 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:35.143076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:35.143772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:35.151120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.151561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.152412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.152839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.298737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:35.313327 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bc485bfc-2e6a-49d5-8597-845e660ffba6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.168134 Dec 15 14:14:35.313949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 112/212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:35 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:35.796976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:35.798115 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:35.805642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.806362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.807194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.807757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.856870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:35.856870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:35.858383 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.859374 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.860573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:35.861233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:35.897621 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-08e79b3b-4a8e-48ff-833d-0abcf8022bce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28445 microversion: 2.20 time: 0.104980 Dec 15 14:14:35.898274 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 101/213] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:35 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:35.964287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6c7abe1e-9d93-4434-8cd9-f996c26d67c6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 27501 microversion: 2.1 time: 0.121768 Dec 15 14:14:35.965058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 113/214] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:35 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 27501 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:36.330821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:36.331732 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:36.339463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.339907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.340749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.341176 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.493337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:36.500353 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8c6e5ca3-308a-4657-a509-983ae4f39b48 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.173448 Dec 15 14:14:36.501160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 102/215] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:36 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:36.910973 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:36.911988 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:36.919525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.919991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.920795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:36.921222 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:36.983454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:36.984977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:36.997182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.006087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.006087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.006087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.019784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5ea96512-5cd5-485a-a45b-62701ac2f3b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.113052 Dec 15 14:14:37.020699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 114/216] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:36 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:37.093370 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6928d9c2-c4e4-4dba-8df1-d0419b471968 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 27731 microversion: 2.1 time: 0.120300 Dec 15 14:14:37.094061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 103/217] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:36 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 27731 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:37.526638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:37.527328 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:37.534057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.534495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.535261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:37.535685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:37.675753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:37.684415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6095f9ac-0087-424f-b9e1-f84c8bb5f027 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.162477 Dec 15 14:14:37.691205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 115/218] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:37 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:38.045063 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:38.046060 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:38.064473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.065002 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.065873 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.066391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.107008 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:38.107910 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:38.114929 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.116495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.117285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.117884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.152928 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dfbef5e7-9fed-4889-bedb-e5092c9e1d32 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.116377 Dec 15 14:14:38.154360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 104/219] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:38 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:38.210952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7a5c0a03-06e8-4f69-8839-ced3e254041d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28151 microversion: 2.1 time: 0.108041 Dec 15 14:14:38.214299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 116/220] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:38 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28151 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:38.702489 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:38.703179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:38.709891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.710335 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.711110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:38.711534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:38.871961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:38.879704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d7a4d679-0e88-49bf-ae48-8d72f4e3abaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.181211 Dec 15 14:14:38.880311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 105/221] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:38 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:39.164942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:39.166434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:39.173191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.173639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.174420 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.174885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.225494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:39.226412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:39.233034 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.233484 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.234407 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.234850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.257100 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-206295e8-d734-4d84-9266-7054b8ce20bd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.094803 Dec 15 14:14:39.257100 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 117/222] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:39 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:39.326559 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dd9b0990-a5c1-4cbf-8b1e-a4c47aac51b6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28153 microversion: 2.1 time: 0.105058 Dec 15 14:14:39.327206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 106/223] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:39 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28153 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:39.898063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:39.898947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:39.906474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.906993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:39.907839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:39.908360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.071711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:40.079721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-72b2ce03-b448-4539-9f60-014f2f0d3732 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.185646 Dec 15 14:14:40.080266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 118/224] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:39 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:40.269328 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:40.270348 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:40.278088 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.278538 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.279327 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.279767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.338984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:40.339897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:40.346221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.346671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.347451 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:40.347886 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:40.363264 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b03ecc9e-eb9c-42f8-9758-12395b90c8c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.097693 Dec 15 14:14:40.366490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 107/225] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:40 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:40.438802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc4eeacf-42b1-4e50-bd79-72f60fc431ee tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28280 microversion: 2.1 time: 0.104023 Dec 15 14:14:40.439493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 119/226] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:40 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:41.098665 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:41.099645 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:41.107506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.108050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.108835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.109264 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.291508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:41.301499 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e7131d2b-432f-4ec1-bf12-cef5c6cb2574 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.205698 Dec 15 14:14:41.302550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 108/227] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:41 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:41.377934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:41.379032 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:41.387071 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.387638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.388532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.389035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.451821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:41.453640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:41.474110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1dba63de-9c5b-48d8-9c48-88a569f618cc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.093226 Dec 15 14:14:41.475163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 120/228] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:41 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:41.478539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.479086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.480310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:41.486948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:41.561675 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-03a25ace-ccdb-4f75-b11b-a0e500a688ad tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28443 microversion: 2.1 time: 0.114912 Dec 15 14:14:41.562374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 109/229] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:41 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:42.319543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:42.521673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:42.521673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.521673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.521673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.522730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.522730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:42.522730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-659e3f4a-fa46-4623-864d-fe2839ebe1da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.158922 Dec 15 14:14:42.522730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 121/230] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:42 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:42.523066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:42.523066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:42.523066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.523066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.523676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.523676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.571265 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-aee5449f-6eaa-4bc1-9f3d-6253c8c4b371 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 28613 microversion: 2.20 time: 0.088150 Dec 15 14:14:42.573032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 110/231] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:42 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 28613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:42.575405 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:42.576369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:42.582277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.582739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.583543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:42.584013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:42.671468 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2427bdcc-c388-4e8f-bbb2-1b4fbcea9c9a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28609 microversion: 2.1 time: 0.100299 Dec 15 14:14:42.675632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 122/232] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:42 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:43.527173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:43.527868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:43.534750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.535203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.540746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.540746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.585127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:43.586026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:43.593559 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.594322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.595108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.595544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.680580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:43.681786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-55f72fd3-b222-4121-9e65-4a36ef23cc06 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 29874 microversion: 2.20 time: 0.100784 Dec 15 14:14:43.686505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 123/233] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:43 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 29874 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:43.688786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:43.689770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:43.690861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d22049ca-e3a6-4a23-b86b-af96141fae76 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.168175 Dec 15 14:14:43.691606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 111/234] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:43 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:43.697489 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.700399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.700399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:43.700399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:43.782917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-420aa484-1d7b-4172-9a53-172d68af4480 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28611 microversion: 2.1 time: 0.098287 Dec 15 14:14:43.783581 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 124/235] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:43 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28611 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:44.697605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:44.698513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:44.708694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.714111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.714111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.714111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.716753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:44.717988 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:44.725592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.726281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.727291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.728538 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.796826 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-60c5bab6-a243-4777-9ab3-0f10fe834a4c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 31575 microversion: 2.20 time: 0.106582 Dec 15 14:14:44.798103 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 112/236] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:44 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 31575 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:44.806390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:44.807821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:44.816686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.817541 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.818508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:44.819749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:44.872966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:44.880334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2155cdbd-9ae0-4a1a-a77d-82f67aeca2a3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.168767 Dec 15 14:14:44.880886 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 125/237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:44 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:44.887448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-39406873-9c5b-4a5b-8f42-f35e9eb2e369 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28611 microversion: 2.1 time: 0.087558 Dec 15 14:14:44.890766 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 113/238] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:44 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28611 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:45.811850 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:45.813024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:45.819966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.820533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.821399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.822891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.898529 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:45.899916 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:45.901266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c58d73d4-dc47-449a-aec2-df819dad57f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 32941 microversion: 2.20 time: 0.096698 Dec 15 14:14:45.905461 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 126/239] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:45 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 32941 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:45.908137 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.908789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.909549 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:45.909927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.910519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.910930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:45.920524 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.921088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.928835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:45.928835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:45.994810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-66a151ef-5284-43cc-8868-013a2a5e0c73 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28611 microversion: 2.1 time: 0.090524 Dec 15 14:14:45.995579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 127/240] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:45 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:46.085708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:46.095117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f14adea9-2f5d-4465-8347-f24bb6cea36a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.201255 Dec 15 14:14:46.095705 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 114/241] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:45 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:14:46.915015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:46.917974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:46.925725 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.930895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:46.930895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:46.930895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.012934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:47.016376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:47.028514 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.028964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.029765 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.030376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.132136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e67652e0-1f32-44ac-9bb5-1e2eadc90383 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 28757 microversion: 2.1 time: 0.128970 Dec 15 14:14:47.132790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 115/242] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:47 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 28757 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:47.138774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:47.139508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:47.148447 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.150810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.150810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:47.150810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:47.174218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3f218f2f-3209-44bf-a47d-7ffb5db95915 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 33762 microversion: 2.20 time: 0.264339 Dec 15 14:14:47.179686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 128/243] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:46 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 33762 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:47.322982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:47.330497 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9ccb9c20-c105-4c19-82e4-9571a3fe6d3f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.196455 Dec 15 14:14:47.331167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 116/244] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:47 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:48.144459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:48.145610 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:48.154498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.155194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:48.156135 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.156704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:48.188056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:48.189682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:48.200377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.200823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:48.201686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:48.202118 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.035818 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-181d8169-6308-4faa-b4b1-7e53ec873745 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 32567 microversion: 2.1 time: 1.895665 Dec 15 14:14:50.044768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 129/245] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:48 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 32567 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:50.044768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:50.044768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:50.049687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.050252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.051259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:50.051697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:50.054280 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7c80ebc7-4a52-46e7-b8d5-94df77c79c83 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 36383 microversion: 2.20 time: 1.870144 Dec 15 14:14:50.054934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 117/246] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:48 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 36383 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:50.202957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:50.212863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-af981cd0-468f-4649-85c6-c9722cd21116 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.174274 Dec 15 14:14:50.213939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 130/247] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:50 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:51.056632 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:51.063827 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:51.065363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.065815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.066607 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.067004 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:51.067460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.067949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:51.075534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.075999 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.079627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.080121 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.160975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a3327b49-91d2-484a-9767-7bc295eae18c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 33141 microversion: 2.1 time: 0.108758 Dec 15 14:14:51.161894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 118/248] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:51 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 33141 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:51.190391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b0bd23ed-0e7f-4a95-a029-eb0f4c904a4e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 37115 microversion: 2.20 time: 0.124497 Dec 15 14:14:51.191202 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 131/249] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:51 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 37115 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:51.231183 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:51.231963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:51.254848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.256522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.259513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:51.260415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:51.436071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:51.448381 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b73a7e0a-7d3e-4bda-88b4-4a047cd31242 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.221403 Dec 15 14:14:51.449174 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 119/250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:51 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:52.174532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:52.176171 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:52.184465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.184983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.185834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.186274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.204875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:52.206582 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:52.214871 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.215461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.216164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.216612 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.272319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-eb5616c3-7edd-4a8a-8dd4-8d9071cb172f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 33664 microversion: 2.1 time: 0.102141 Dec 15 14:14:52.277124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 132/251] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:52 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 33664 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:52.322199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-067c10de-7182-462e-a637-4c90dfed804b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 38134 microversion: 2.20 time: 0.122928 Dec 15 14:14:52.324881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 120/252] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:52 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 38134 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:52.473266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:52.475127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:52.487355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.487355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.487355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:52.487355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:52.687431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:52.695146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a381cf40-5184-48df-95aa-a6a08a821fc8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1522 microversion: 2.1 time: 0.227128 Dec 15 14:14:52.697514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 133/253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:52 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:53.287228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:53.288887 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:53.299744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.300351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.301768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.302673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.334821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:53.335826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:53.342697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.343142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.343949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.344507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.383626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c044ad91-9da2-4987-b66f-16953180b75a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 34580 microversion: 2.1 time: 0.101795 Dec 15 14:14:53.384477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 121/254] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:53 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 34580 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:53.430413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e6d89203-b245-4e58-bcc7-2abd64974f92 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 38162 microversion: 2.20 time: 0.099293 Dec 15 14:14:53.431718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 134/255] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:53 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 38162 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:53.722326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:53.724117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:53.734426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.734879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.736081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.736576 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.876401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:53.884015 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4825336d-1d3c-4ddb-aea5-d33fa79298a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1502 microversion: 2.1 time: 0.173082 Dec 15 14:14:53.884756 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 122/256] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:53 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:53.901419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:53.902181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:53.912683 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.913266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:53.914447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:53.914885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.048072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:54.056387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1762e638-d308-4a8d-854d-85d339b931ff tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1515 microversion: 2.1 time: 0.159610 Dec 15 14:14:54.056975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 135/257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:53 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:54.395999 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:54.397610 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:54.404747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.405195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.405977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.406432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.443683 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:54.445183 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:54.452631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.452979 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.453828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:54.455866 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:54.492603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-59bc2af3-2b2c-493b-a2ee-2b4c041418b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 35434 microversion: 2.1 time: 0.100137 Dec 15 14:14:54.494099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 123/258] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:54 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 35434 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:54.526700 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f02779a1-5eda-4f48-acac-eaf2d47727bf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 38162 microversion: 2.20 time: 0.086618 Dec 15 14:14:54.527346 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 136/259] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:54 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 38162 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:14:55.506303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:55.508029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:55.517130 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.517848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.519077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.519728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.539313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:55.540555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:55.559518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.559518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.559518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.559518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.637261 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-78bfdd13-ec31-4a63-a50c-ca1cf5642228 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 36766 microversion: 2.1 time: 0.135254 Dec 15 14:14:55.641851 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 124/260] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:55 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 36766 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:55.660717 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1978777d-e5aa-493f-a682-c711e15ac399 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 200 len: 38303 microversion: 2.20 time: 0.125170 Dec 15 14:14:55.664542 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 137/261] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:55 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 38303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:14:55.674170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:55.674753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:55.683414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.683870 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.684699 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:55.686092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:55.711832 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0efd9714-84a6-43cf-a84b-e6eb72c196c6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.041984 Dec 15 14:14:55.713373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 125/262] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Dec 15 14:14:55 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:14:56.524485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:56.527030 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:56.543952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.543952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.543952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.543952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.576881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lazy-loading 'flavor' on Instance uuid 0055c3fd-c364-425b-a659-292f94e6f09c {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:14:56.651042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:56.652052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:56.664449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.666228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.668479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:56.669961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:56.752180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7615374b-2be3-4df5-97ee-34d836e1ae32 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 38080 microversion: 2.1 time: 0.105901 Dec 15 14:14:56.752861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 126/263] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:56 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 38080 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:57.177730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b29ab610-0a7f-4952-abaa-ea469efae7fe tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action" status: 200 len: 32 microversion: 2.1 time: 0.659364 Dec 15 14:14:57.178448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 138/264] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:56 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action => generated 32 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:14:57.190346 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:57.190976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:57.208034 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.208611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.209599 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.209958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.490062 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:57.499187 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5127ea28-f8ae-4078-a11a-bfa1d7e437f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.315212 Dec 15 14:14:57.499766 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 127/265] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:57 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:57.777154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:57.778654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:57.791596 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.796684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.809723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:57.809723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:57.922316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-70dbad06-1610-4d65-8395-79e5fd75023a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 38135 microversion: 2.1 time: 0.152291 Dec 15 14:14:57.923031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 139/266] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:57 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 38135 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:58.473214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:58.473752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:58.484208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.484906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.486102 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.487095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.518501 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:58.519299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:58.528889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lazy-loading 'flavor' on Instance uuid 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:14:58.535041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.535041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.535041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.535041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.680401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:58.688804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c7d77012-d947-46ac-802d-bc1bf0802f16 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.175024 Dec 15 14:14:58.689484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 140/267] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:58 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:14:58.938081 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:14:58.939187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:58.945739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.946413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:58.948345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:58.948985 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.018153 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-11a38e44-b657-4517-9b7f-fc6939e96ec5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 38135 microversion: 2.1 time: 0.087298 Dec 15 14:14:59.019459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 141/268] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:14:58 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 38135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:14:59.262276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6a6bcefc-b816-48cb-b00e-04c84b770c7a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 202 len: 0 microversion: 2.20 time: 0.794572 Dec 15 14:14:59.263739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 128/269] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:14:58 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:14:59.276735 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:59.277812 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:59.284220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.284666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.285577 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.286008 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.457859 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:59.467656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:59.469984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:59.472348 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c6b63a35-98cd-4789-ad41-095ca421e0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.201967 Dec 15 14:14:59.483825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 142/270] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:14:59 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:14:59.709903 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:14:59.713163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:14:59.719070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.719520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.720815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:14:59.721568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:14:59.878910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:14:59.891593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-60999fde-74da-4e95-8a9d-087f05d99a8d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.185973 Dec 15 14:14:59.891593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 129/271] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:14:59 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:00.036761 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:00.037772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:00.044661 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.045110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.045912 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.046342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.123529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e590d408-836b-49c0-a537-d00f7eb0aca0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 38135 microversion: 2.1 time: 0.090138 Dec 15 14:15:00.124265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 143/272] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:15:00 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 38135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:15:00.492143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:00.492683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:00.499193 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.499641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.500443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.500873 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.645427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:00.655734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:00.661293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:00.661293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-afa59801-e0f3-44dc-ad4b-4e5da61192eb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.171026 Dec 15 14:15:00.661293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 130/273] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:00 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:00.917353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:00.918305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:00.926697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.927674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:00.928731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:00.929644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.135754 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:01.136791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:01.142570 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:01.143017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.143797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:01.144253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.153486 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:01.162043 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6ee29fc3-17ba-400f-84a8-a25967ff659c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.253024 Dec 15 14:15:01.162626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 144/274] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:00 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:01.677227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:01.677854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:01.684943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:01.685424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.686247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:01.686679 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:01.839136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:01.846985 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:01.848594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:01.850027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e0d02328-4ada-4f79-8305-ac790e76d3a1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.176433 Dec 15 14:15:01.850765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 145/275] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:01 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:02.191832 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:02.192480 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:02.198674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.199122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:02.199939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.200392 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:02.330044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:02.338411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-996cc2c6-74e4-495f-8047-ebb3e9f645fa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.149781 Dec 15 14:15:02.338979 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 146/276] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:02 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:02.868766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:02.869434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:02.875633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.876125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:02.877117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:02.877562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.008164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:03.015902 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:03.017472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:03.018611 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6b785c91-3132-4a1a-8e62-d0e4d36f5b99 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.154252 Dec 15 14:15:03.019161 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 147/277] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:02 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:03.361783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:03.362419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:03.368918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.369365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.370132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.370562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.500249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:03.507598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ec5672a3-613d-49ca-9e3c-d162ee1e5af5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.149521 Dec 15 14:15:03.508248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 148/278] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:03 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:03.855473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-56ad858b-6faf-4027-986a-06d336263b43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 200 len: 38264 microversion: 2.1 time: 2.723298 Dec 15 14:15:03.856284 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 131/279] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:15:01 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 38264 bytes in 2725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:15:03.865862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:03.866375 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:03.872296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.872735 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.873504 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:03.873972 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:03.898345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c53b6131-191b-4d17-a3b2-14cf001f7770 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/ips" status: 200 len: 144 microversion: 2.1 time: 0.036076 Dec 15 14:15:03.898916 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 149/280] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:15:03 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:15:04.038112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:04.038925 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:04.046699 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.047155 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.047982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.048450 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.184278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:04.192221 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:04.193855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:04.195004 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6c474187-1a85-4047-9ad6-02ca384a705b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.161291 Dec 15 14:15:04.195561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 132/281] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:04 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:04.525263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:04.525821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:04.531645 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.532158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.532996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:04.533430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:04.670520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:04.677798 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c14c1727-5f57-4c77-b238-aad6340dfa95 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.156616 Dec 15 14:15:04.678358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 150/282] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:04 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:05.214660 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:05.215310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:05.221412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.221864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.222648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.223085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.351322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:05.359273 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:05.360858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:05.362016 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9c986c96-56a5-4c22-a5ab-0f63ff1f7bda tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.151991 Dec 15 14:15:05.362767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 133/283] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:05 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:05.695638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:05.696463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:05.703387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.703829 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.704626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:05.705052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:05.837614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:05.845557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c8f0db11-535b-43de-86df-069a22bfb0e6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.153636 Dec 15 14:15:05.846135 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 151/284] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:05 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:06.380156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:06.380716 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:06.387027 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.387476 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:06.389052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.389584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:06.517988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:06.525683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:06.527228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:06.528410 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-556d02d2-b5a4-4a5c-a6de-884c8eedc56c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.152254 Dec 15 14:15:06.528977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 134/285] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:06 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:06.863218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:06.863828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:06.870036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.870478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:06.871245 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:06.871678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:06.999516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:07.007253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-41f63b68-1166-475f-ab11-9702a01c09b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.147669 Dec 15 14:15:07.007827 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 152/286] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:06 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:07.546720 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:07.547331 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:07.553528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:07.553972 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:07.554737 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:07.555163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:07.691099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:07.698811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:07.700377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:07.702289 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-54e5550f-1ee7-4dbe-a99f-f8c44fec85dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.159219 Dec 15 14:15:07.703147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 135/287] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:07 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:08.024687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:08.025289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:08.032711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.033261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.034285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.034854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.165316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:08.172764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8d54aeab-9637-4551-89f8-d688e97bf5bb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.151801 Dec 15 14:15:08.173338 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 153/288] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:08 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:08.720561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:08.721479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:08.728472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.728913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.729721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:08.730148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:08.866065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:08.874367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:08.875940 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:08.877088 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-adbbdc65-ff3c-4c18-bbf4-c9ef330043c8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.160766 Dec 15 14:15:08.877640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 136/289] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:08 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:09.189771 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:09.190531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:09.196922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.197365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:09.198138 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.198579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:09.361173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:09.368592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-903a8d49-0564-4d37-ad4a-f0b09635c177 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.182531 Dec 15 14:15:09.369204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 154/290] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:09 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:09.895109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:09.895643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:09.901944 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.902390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:09.903195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:09.903627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:10.035876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:10.044234 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:10.045742 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:10.046891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-da8bb259-1864-45ac-929f-95d332035464 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.155629 Dec 15 14:15:10.047443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 137/291] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:09 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:10.385743 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:10.392913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:10.393236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:10.393685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:10.394457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:10.394895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:10.530152 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:10.537517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1f582ac1-2d5f-4598-a2d0-c38df134219f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.155582 Dec 15 14:15:10.538077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 155/292] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:10 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:11.065650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:11.067575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:11.074246 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.074738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.075492 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.075875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.217448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:11.226577 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:11.228164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:11.237581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c7b45437-05e2-4746-a116-f42a15999e5f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.167541 Dec 15 14:15:11.237581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 138/293] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:11 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:11.554777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:11.555389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:11.565236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.565236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.566916 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:11.567532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:11.718793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:11.726314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-deb7077c-72d5-4fd2-83f8-5ea0c3e09668 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.175625 Dec 15 14:15:11.736691 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 156/294] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:11 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:12.250163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:12.250985 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:12.257489 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.258706 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:12.259503 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.259956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:12.392636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:12.400657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:12.402133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:12.403285 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-69996ec0-94aa-410a-ad15-e5303b00cbf1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.157786 Dec 15 14:15:12.403849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 139/295] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:12 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:12.743997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:12.746113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:12.750759 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.751207 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:12.752053 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:12.752488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:12.881925 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:12.889210 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4acce311-214a-4fbd-bd75-f6202457a9ee tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.148963 Dec 15 14:15:12.889764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 157/296] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:12 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:13.420911 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:13.421555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:13.428139 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:13.428631 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:13.429415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:13.429870 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:13.558864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:13.567947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:13.569430 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:13.570575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d09e7fe0-e713-4ed3-b8af-69a6863279a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.153640 Dec 15 14:15:13.571128 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 140/297] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:13 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:13.906299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:13.906904 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:13.913071 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:13.913508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:13.914274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:13.914701 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.049469 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:14.056730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c7dbcc50-2929-4a05-8528-6af375326749 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.154342 Dec 15 14:15:14.057292 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 158/298] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:13 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:14.589461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:14.590070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:14.597080 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.597585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.598349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.598783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.659697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d493ca0-9573-4cde-897d-22b3666f370b"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:14.661096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:14.667361 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.668638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.669487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:14.669925 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:14.732188 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:14.747784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:14.747784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:14.747784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a82065be-4e29-49cd-a962-9b72e81c1f0c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.161766 Dec 15 14:15:14.755985 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 141/299] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:14 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:15.073438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:15.074046 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:15.086957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.087405 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.088715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.088715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.274753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:15.282239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2cc5fd2b-3cbe-42f4-ace8-017b71b6c131 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.212396 Dec 15 14:15:15.282812 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 142/300] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:15 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:15.287171 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-474942146", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "64950cd0-9dda-4cbf-8aa1-d2615e4306bd"}]}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:15.340279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] validate_networks() for [('64950cd0-9dda-4cbf-8aa1-d2615e4306bd', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:15:15.521045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d61c9ae6-607f-4a4f-87f5-885b7a2a1a14 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866242 Dec 15 14:15:15.521599 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 159/301] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:15:14 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:15:15.766896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:15.767586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:15.773651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.774187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.774962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.775419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.945862 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:15:15.952071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:15:15.952071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:15:15.952071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:15:15.952071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:15:15.973356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.973970 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.981795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:15.981795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:15.987652 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:15.995890 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:15.997480 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:16.004458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Getting quotas for project f9d3f092c855418592b191699ec2f37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:15:16.004580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b6f4a220-3c45-49a5-bc1f-24a7b59573fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1743 microversion: 2.20 time: 0.241727 Dec 15 14:15:16.005044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 160/302] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:15 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1743 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:16.008162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Getting quotas for user 6619a505b22b41a1974d6b5934846741 and project f9d3f092c855418592b191699ec2f37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:15:16.019904 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:15:16.022332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:15:16.146533 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-053372e7-3d33-4f08-b313-ee5b6d072da2 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862695 Dec 15 14:15:16.147185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 143/303] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:15:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:15:16.158127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b27981c6-710f-4975-8af5-d6cb71e40469 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:16.158735 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b27981c6-710f-4975-8af5-d6cb71e40469 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:16.209532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b27981c6-710f-4975-8af5-d6cb71e40469 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:16.216634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b27981c6-710f-4975-8af5-d6cb71e40469 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1218 microversion: 2.1 time: 0.063299 Dec 15 14:15:16.218287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 161/304] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:16 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:16.299049 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:16.299720 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:16.305913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:16.306370 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:16.307182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:16.307625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:16.439261 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:16.446572 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-aa6f3fcb-b3fa-48aa-9cdb-567739bc8d77 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.151454 Dec 15 14:15:16.447139 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 144/305] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:16 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:17.029875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:17.030584 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:17.038130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.038580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.039400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.039833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.175354 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.183204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.184775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.191099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-86824746-599c-41b2-9b6b-5e51034107ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1743 microversion: 2.20 time: 0.160594 Dec 15 14:15:17.191099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 162/306] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:17 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:17.236117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:17.236740 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:17.243249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.243712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.244550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.244975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.303324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.310631 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2f6571f0-4e6d-410e-9343-94d35e72d486 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1222 microversion: 2.1 time: 0.079450 Dec 15 14:15:17.311219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 145/307] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:17 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:17.464455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:17.464987 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:17.471403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.471883 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.472684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:17.473131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:17.601769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:17.609791 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e8adeb47-91ec-419f-ae43-a591663115aa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.149088 Dec 15 14:15:17.610356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 163/308] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:17 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:18.204378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:18.204984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:18.210877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.211316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.212160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.212585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.328948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:18.330245 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:18.336609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.337057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.337918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.338348 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.355110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:18.363367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:18.365233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:18.366607 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e7a0d340-d378-4fbc-b372-7c9d85533d91 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1743 microversion: 2.20 time: 0.166584 Dec 15 14:15:18.377684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 146/309] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:18 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:18.408940 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:18.416054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-953f249e-8cf0-4118-ab6f-961268a1318a tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1222 microversion: 2.1 time: 0.093338 Dec 15 14:15:18.416615 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 164/310] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:18 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:18.626258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:18.626796 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:18.632689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.633135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.633908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:18.634342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:18.763052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:18.771064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3b2546d5-d1b8-4090-8201-1591946994a6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.148573 Dec 15 14:15:18.771635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 147/311] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:18 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:19.384737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:19.385373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:19.391617 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.392092 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.392874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.393304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.433026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:19.434271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:19.442603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.443048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.446820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.446820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.536460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.544063 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b8328a00-314c-49f3-99fc-6563f4e79732 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1222 microversion: 2.1 time: 0.115680 Dec 15 14:15:19.544854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 148/312] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:19 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:19.634472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.643593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.645268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.646428 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9310a7e7-e088-4434-a6b8-574d75dc470f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1743 microversion: 2.20 time: 0.265488 Dec 15 14:15:19.649930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 165/313] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:19 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:19.788294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:19.789117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:19.798846 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.802649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.802649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:19.802649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:19.991083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:19.998240 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6d5c8c1f-d3e3-4d8f-ba8a-e3a792ac7e96 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.213678 Dec 15 14:15:19.998790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 149/314] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:19 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:20.561842 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:20.562474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:20.568618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.569049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.569819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.570247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.630555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:20.638359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0ca12ec9-3a5f-4a2a-9f2e-eb931ae5a878 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1270 microversion: 2.1 time: 0.080871 Dec 15 14:15:20.638954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 166/315] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:20 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:20.665744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:20.666499 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:20.673879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.674355 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.675130 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:20.675556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:20.811229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:20.819016 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:20.820798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:20.821985 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7d7cf942-b9de-452c-8349-0c92dbbc6552 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.160268 Dec 15 14:15:20.822545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 150/316] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:20 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:21.014870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:21.015395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:21.021274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.025507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.025507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.025507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.157042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.164136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f13378a0-dc43-4380-8ce3-b78e49ae688b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.153276 Dec 15 14:15:21.164692 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 167/317] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:21 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:21.654646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:21.655430 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:21.661421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.661869 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.662639 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.663076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.721760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.729351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c635d8ab-7772-4b7a-ba20-598425b7d48f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1270 microversion: 2.1 time: 0.078655 Dec 15 14:15:21.729940 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 151/318] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:21 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:21.840505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:21.841042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:21.847466 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.847913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.848712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:21.849146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:21.986090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.993892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.995556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:21.996808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2b1b4829-72ed-4f3e-8b57-d56c1c313a5b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.160176 Dec 15 14:15:21.997359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 168/319] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:21 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:22.046237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-de5cc723-ccc3-4f08-8e2d-2ae0c8aa324c req-cd15cffd-2ee7-48d7-b857-abb997919aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "name": "network-vif-plugged", "status": "completed", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:22.047980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:15:22.047980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:15:22.055028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-de5cc723-ccc3-4f08-8e2d-2ae0c8aa324c req-cd15cffd-2ee7-48d7-b857-abb997919aeb service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.055501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-de5cc723-ccc3-4f08-8e2d-2ae0c8aa324c req-cd15cffd-2ee7-48d7-b857-abb997919aeb service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.066977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-de5cc723-ccc3-4f08-8e2d-2ae0c8aa324c req-cd15cffd-2ee7-48d7-b857-abb997919aeb service nova] Creating event network-vif-plugged:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:15:22.072275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-de5cc723-ccc3-4f08-8e2d-2ae0c8aa324c req-cd15cffd-2ee7-48d7-b857-abb997919aeb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030239 Dec 15 14:15:22.072857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 152/320] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:15:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:15:22.181744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:22.182360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:22.188956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.189415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.190176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.190601 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.317239 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:22.324392 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bce12ab8-f81f-4bb2-b006-fbdca9434165 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.146342 Dec 15 14:15:22.324953 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 169/321] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:22 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:22.746859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:22.747550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:22.754312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.754753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.755669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:22.756315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:22.824692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:22.832733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3b1e2b32-e4ab-4365-9b98-0c821bf5177d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1270 microversion: 2.1 time: 0.090312 Dec 15 14:15:22.833307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 153/322] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:22 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:23.016376 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:23.017091 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:23.023693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.029950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.029950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.029950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.175111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:23.184072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:23.186181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:23.188768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b1544b8a-c497-4bed-ab7d-f1be3dd3515a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.176931 Dec 15 14:15:23.189604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 170/323] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:23 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:23.341409 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:23.342780 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:23.348728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.349182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.349956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.350644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.494133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:23.502392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0fe7a745-c8cd-42f4-a553-3e3fca7eb852 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.164856 Dec 15 14:15:23.503167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 154/324] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:23 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:23.850320 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:23.850759 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:23.864937 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.866098 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.868945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:23.870733 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:23.990362 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:24.009158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-405148b4-b4a6-4163-8839-4f1e6f8ea346 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1278 microversion: 2.1 time: 0.162982 Dec 15 14:15:24.017006 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 171/325] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:23 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:24.208476 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:24.214257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:24.227461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.231029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.232150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.234874 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.498953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:24.507718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:24.509800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:24.511299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-df83062d-d36a-4ff7-8d61-abf8851d1ff2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.306683 Dec 15 14:15:24.525552 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 155/326] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:24 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:24.533727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:24.534303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:24.567534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.567534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.567534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.567534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.802173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:24.815270 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-555754ef-009a-4a15-9d5e-a2752dbbec57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1501 microversion: 2.1 time: 0.288455 Dec 15 14:15:24.819080 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 172/327] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:24 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:24.836859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "631fb8cc-c736-46c4-b953-b51ade19663c"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:24.842378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:24.854899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.857528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.860309 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.864907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.894844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] HTTP exception thrown: Cannot 'attach_volume' instance 0055c3fd-c364-425b-a659-292f94e6f09c while it is in vm_state rescued Dec 15 14:15:24.895442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Returning 409 to user: Cannot 'attach_volume' instance 0055c3fd-c364-425b-a659-292f94e6f09c while it is in vm_state rescued {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:15:24.896466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9cc8236a-5e95-4e43-a434-6d4747b850c3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064475 Dec 15 14:15:24.897312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 156/328] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:15:24 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 14:15:24.905815 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:24.906583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:24.914101 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.923162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:24.923162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:24.923162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.034425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:25.035037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:25.042636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.043092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.043895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.044413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.227493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c817e5e0-b555-4b80-beb6-2c49d196ca22 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action" status: 202 len: 0 microversion: 2.1 time: 0.325185 Dec 15 14:15:25.233835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 173/329] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:15:24 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:15:25.246633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:25.247336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:25.261945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.263220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.267467 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.268266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.331793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:25.341165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bdbdfadb-dd31-4952-9a38-63c0ea8f882d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.310549 Dec 15 14:15:25.345913 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 157/330] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:25 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:25.516528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:25.531840 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1def9dc9-0d42-4a03-94c4-ec6d6d947239 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.295928 Dec 15 14:15:25.532519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 174/331] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:25 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:25.533997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:25.534897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:25.548222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.548769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:25.549475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:25.550021 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.138326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:26.148673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:26.164361 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:26.164361 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4bd488d3-0087-446e-aeee-b5b66d408b68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.625276 Dec 15 14:15:26.164361 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 158/332] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:25 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:26.368576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:26.369409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:26.378367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.379199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.380744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.381382 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.550952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:26.551646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:26.559322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.560173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:26.561425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:26.562360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.111844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.121319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0821576d-93f7-4195-8279-2d3cd32478d9 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.758254 Dec 15 14:15:27.121895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 175/333] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:26 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:27.155550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.162818 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5bf66a4f-8604-41e9-948e-18262d47ad99 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.616672 Dec 15 14:15:27.163459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 159/334] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:26 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:27.186293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:27.186293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:27.186293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:27.186293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.186753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:27.186753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.385268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-60cde027-7d98-4bb5-8d93-d93bf5319ddd req-70e6ce32-31e8-45a6-8f35-c77481395a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb", "tag": "b113c35c-4ca3-4037-96fb-e527b48590e0"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:27.387280 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:15:27.387280 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:15:27.397637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-60cde027-7d98-4bb5-8d93-d93bf5319ddd req-70e6ce32-31e8-45a6-8f35-c77481395a57 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:27.397637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-60cde027-7d98-4bb5-8d93-d93bf5319ddd req-70e6ce32-31e8-45a6-8f35-c77481395a57 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:27.408686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-60cde027-7d98-4bb5-8d93-d93bf5319ddd req-70e6ce32-31e8-45a6-8f35-c77481395a57 service nova] Creating event network-changed:b113c35c-4ca3-4037-96fb-e527b48590e0 for instance ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb on hv-cinder-81322 Dec 15 14:15:27.413554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.415312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-60cde027-7d98-4bb5-8d93-d93bf5319ddd req-70e6ce32-31e8-45a6-8f35-c77481395a57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033663 Dec 15 14:15:27.417249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 160/335] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:15:27.426703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.428858 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:27.430238 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8380a551-7c05-4530-981b-4433cace61f9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.257267 Dec 15 14:15:27.444203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 176/336] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:27 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:28.139449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:28.143834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:28.147400 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.147948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.148757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.149193 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.181750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:28.182651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:28.189541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.190201 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.191308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.191897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.349702 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.361662 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-69c2a6db-3bad-4145-b4ef-8207b48ad5eb tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.226745 Dec 15 14:15:28.363023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 161/337] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:28 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:28.410152 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.417930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ab3b9874-0f55-4934-9aab-c092549559f7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.239976 Dec 15 14:15:28.419166 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 177/338] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:28 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:28.449345 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:28.450064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:28.457061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.457837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.458711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:28.459232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:28.602845 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.611732 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.613726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:28.616813 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3c5cf124-c4fa-4867-aa07-5c59b6631444 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.171253 Dec 15 14:15:28.628142 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 162/339] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:28 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:29.378903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:29.379956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:29.386526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.387206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.388215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.389016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.435447 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:29.436179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:29.443037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.443787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.444771 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.445259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.608185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.619509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-25820b63-6ee4-4f86-99df-b5f8246dd480 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.244259 Dec 15 14:15:29.620542 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 178/340] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:29 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:29.634922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:29.635523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:29.636607 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.642992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.643800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.644628 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:29.645053 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:29.648758 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-495e6742-036d-4d56-a5ac-00404f762fce tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.216910 Dec 15 14:15:29.650253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 163/341] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:29 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:29.835273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.847238 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.849315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:29.850978 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f1f839a6-9f53-4c0b-a214-1fc9a62e1fe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.220180 Dec 15 14:15:29.851625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 179/342] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:29 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:30.650253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:30.650253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:30.650253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.650253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.651113 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.651113 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.666232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:30.666838 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:30.673254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.673697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.674474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.674901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.904564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:30.913143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-10739476-a4d9-4b25-9e36-552b7713fa4f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.279759 Dec 15 14:15:30.923668 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 164/343] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:30 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:30.925986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:30.936569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:30.937165 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2b856ab4-aefc-4887-b183-159527395dd6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.274498 Dec 15 14:15:30.937653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:30.937774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 180/344] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:30 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:30.944017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.944824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:30.945840 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:30.946507 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:31.260373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:31.270137 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:31.271906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:31.273107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-81eea094-3e48-4c9a-abae-278d49a57670 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.348033 Dec 15 14:15:31.273668 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 165/345] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:30 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:31.932041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:31.933181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:31.939770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:31.940253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:31.941273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:31.941889 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:31.955072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:31.955788 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:31.964669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:31.967367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:31.970011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:31.970531 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:32.229136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.238858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.251315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-813dd247-2b38-49a6-8199-671c7a48788c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1509 microversion: 2.1 time: 0.300722 Dec 15 14:15:32.251696 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-696e1f2a-4ba9-4d11-9cc1-416e6dcfd268 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.324335 Dec 15 14:15:32.252334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 181/346] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:31 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:32.256260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 166/347] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:31 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:32.292920 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:32.294553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:32.302078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:32.302728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:32.303681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:32.304472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:32.496049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.506452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.508335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:32.511020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-421d0104-5750-47d6-88e0-95b854318721 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.222821 Dec 15 14:15:32.511582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 182/348] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:32 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:33.131829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-819e195b-e846-4b74-8ca0-81b1a519d0fa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:33.145788 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-819e195b-e846-4b74-8ca0-81b1a519d0fa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.146587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-819e195b-e846-4b74-8ca0-81b1a519d0fa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.225509 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-819e195b-e846-4b74-8ca0-81b1a519d0fa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Going to try to stop instance {{(pid=116681) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 14:15:33.270093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:33.270709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:33.278181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.279204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.280278 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.280866 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.443426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-819e195b-e846-4b74-8ca0-81b1a519d0fa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 202 len: 0 microversion: 2.1 time: 0.314799 Dec 15 14:15:33.450836 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 167/349] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:15:33 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:15:33.455506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:33.456233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:33.470166 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.472086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.473073 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.475405 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.488677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:33.506013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6486dda4-2e46-45e3-b659-a82c6d0cfd57 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.239683 Dec 15 14:15:33.506966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 183/350] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:33 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:33.513465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:33.514506 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:33.522721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.527330 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.527330 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.527330 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.695504 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:33.704642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6efcb1b4-bb14-4906-a114-63a9b4bf7eb1 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1515 microversion: 2.1 time: 0.258258 Dec 15 14:15:33.705491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 168/351] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:33 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:33.709955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:33.710723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:33.727000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.729731 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.730924 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:33.731663 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:33.846993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:33.861937 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a0f47a91-d2ab-48ef-b4b3-1400f2ee186a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.353297 Dec 15 14:15:33.871168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 184/352] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:33 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:34.004395 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:34.032898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:34.039414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:34.041762 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eb645a62-f903-4aa9-aa6e-8e351fea919f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.335169 Dec 15 14:15:34.042569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 169/353] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:33 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:34.522496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:34.523109 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:34.529427 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.529865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:34.530626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.531053 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:34.659872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:34.666957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-46dc971c-a858-40c4-a1fb-95d76cc12857 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.148177 Dec 15 14:15:34.667517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 185/354] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:34 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:34.880679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:34.882082 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:34.888720 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.889472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:34.895238 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:34.895910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.061797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:35.062828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:35.073555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.074271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.075232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.075351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:35.076106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.086329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f4d691e6-2d1e-4822-863f-22b96ba5d32f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.209422 Dec 15 14:15:35.087129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 170/355] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:34 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:35.260367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:35.272484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:35.277129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:35.279331 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-40318bf2-5528-4f84-9383-fed02d9fcca4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.221085 Dec 15 14:15:35.296382 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 186/356] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:35 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:35.684734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:35.685578 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:35.691895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.692520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.693434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:35.693923 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:35.833956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:35.842438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4019cf46-f70b-4c73-a371-cc79145b3b38 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.161281 Dec 15 14:15:35.842640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 171/357] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:35 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:36.108672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:36.116191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:36.124154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.132031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:36.133215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.133215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:36.270045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:36.274940 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-27a16b1d-05c7-48e9-8cfb-eedd2e1fa26a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.171224 Dec 15 14:15:36.275508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 187/358] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:36 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:36.301404 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:36.302018 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:36.308354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.308807 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:36.309622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.310606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:36.439569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:36.447356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:36.448929 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:36.450081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8faeb6cc-ce73-4a56-be36-494b9a1b6fbc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.152407 Dec 15 14:15:36.451223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 172/359] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:36 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:36.858984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:36.859519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:36.865301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.865738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:36.866507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:36.866933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.056844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.065582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-51d3a80a-05df-4dee-a6f2-b157ecde7d79 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.210820 Dec 15 14:15:37.066150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 188/360] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:36 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:37.292212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:37.292858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:37.299689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.300236 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.301025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.301597 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.437306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.445168 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3d566171-f005-4007-9f80-1fcf763cfb69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.157051 Dec 15 14:15:37.445736 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 173/361] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:37 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:37.469609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:37.473654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:37.476846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.477288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.478052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:37.478474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:37.640821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.648567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.650175 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:37.651540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-505fa0bf-eb74-4271-b444-d380f3822550 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1738 microversion: 2.20 time: 0.186287 Dec 15 14:15:37.652203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 189/362] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:37 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:38.085095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:38.085095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.089810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.090253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.091024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.092565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.350729 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.358916 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9cc1229b-a797-42ff-83c8-07359c155747 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.279842 Dec 15 14:15:38.359606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 174/363] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:38 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:38.391782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:38.392656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.398677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.399122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.399892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.400526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.461695 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:38.462639 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.472045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.473091 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.474243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.474738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.611684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.619453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fef117a1-42bc-4216-8ba6-39e814a6c580 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1515 microversion: 2.1 time: 0.231686 Dec 15 14:15:38.620049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 190/364] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:38 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:38.636322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad2b327-3989-4640-8e80-faa0b67ad9de"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:38.637429 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.643985 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.644441 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.645287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.645728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.653362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.662154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-edd6f0ad-6759-4854-a76e-9ebe7f4d68ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.204039 Dec 15 14:15:38.662746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 175/365] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:38 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:38.670465 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:38.671310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:38.677809 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.682316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.682316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:38.682316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:38.817999 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.827397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.829165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:38.830405 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-37c59706-4a3c-41a3-8440-4dea37b472df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1720 microversion: 2.20 time: 0.163959 Dec 15 14:15:38.831064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 176/366] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:38 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:39.375961 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:39.376562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:39.382436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.382877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.383655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.384118 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.474526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-630a7cd9-a734-4b0c-80bc-83349efa1ef7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840939 Dec 15 14:15:39.476491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 191/367] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:15:38 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:15:39.545323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-5b276fe5-418b-4a67-b966-dabc107e3187 req-2e977fdb-5657-4160-8589-efc3b63c0826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb", "name": "network-vif-plugged", "status": "completed", "tag": "b113c35c-4ca3-4037-96fb-e527b48590e0"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:39.547603 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:15:39.547603 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:15:39.554898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:39.556843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-5b276fe5-418b-4a67-b966-dabc107e3187 req-2e977fdb-5657-4160-8589-efc3b63c0826 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.562814 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-5b276fe5-418b-4a67-b966-dabc107e3187 req-2e977fdb-5657-4160-8589-efc3b63c0826 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.564487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b26d4938-fdd5-4f29-b55a-90faac6b6492 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.192029 Dec 15 14:15:39.567653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 177/368] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:39 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:39.583322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-5b276fe5-418b-4a67-b966-dabc107e3187 req-2e977fdb-5657-4160-8589-efc3b63c0826 service nova] Creating event network-vif-plugged:b113c35c-4ca3-4037-96fb-e527b48590e0 for instance ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb on hv-cinder-81322 Dec 15 14:15:39.590431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-5b276fe5-418b-4a67-b966-dabc107e3187 req-2e977fdb-5657-4160-8589-efc3b63c0826 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048926 Dec 15 14:15:39.590431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 192/369] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:15:39.678931 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:39.679898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:39.686431 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.687214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.688490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.689024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.852506 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:39.854363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:39.859860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:39.864910 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.865773 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.866849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:39.867687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:39.868211 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dc17e283-090c-4cb3-b6da-d28b998c70ae tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.193358 Dec 15 14:15:39.872070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 178/370] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:39 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:40.300042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:40.308377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:40.309944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:40.311449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-86f28f9e-2731-4e26-bf9c-581309bce16c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1720 microversion: 2.20 time: 0.465583 Dec 15 14:15:40.312029 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 193/371] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:39 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1720 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:40.582045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:40.582653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:40.588980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.591768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:40.591768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.591768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:40.728188 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:40.736347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9381aee4-9bc5-40a0-927f-98bc896b879d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.158062 Dec 15 14:15:40.736798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 179/372] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:40 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:40.887703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:40.889525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:40.898176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.898176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:40.898176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:40.898176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.031852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.040273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-93ba774f-c4c4-4eca-a62c-a49b332345ef tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.156190 Dec 15 14:15:41.040829 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 194/373] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:40 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:41.330450 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:41.331453 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:41.339332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.339939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.341781 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.342229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.494820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.509784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.511464 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.512682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-464074a0-4ae6-4ddb-bc05-fbee7aeafb2c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1723 microversion: 2.20 time: 0.186113 Dec 15 14:15:41.513624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 180/374] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:41 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:41.531084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a277577-3394-47a7-bfff-fe8be6349fe6"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:41.532515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:41.538991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.539430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.540288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.540709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.674786 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-f4b0f5e9-613d-4cea-b96f-65b5e1c43c2b req-f05c949c-f14b-4c43-8fc6-83a2562aa2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "name": "network-vif-unplugged", "status": "completed", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:41.676798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:15:41.676798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:15:41.712283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-f4b0f5e9-613d-4cea-b96f-65b5e1c43c2b req-f05c949c-f14b-4c43-8fc6-83a2562aa2f8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.712728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-f4b0f5e9-613d-4cea-b96f-65b5e1c43c2b req-f05c949c-f14b-4c43-8fc6-83a2562aa2f8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.740203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-f4b0f5e9-613d-4cea-b96f-65b5e1c43c2b req-f05c949c-f14b-4c43-8fc6-83a2562aa2f8 service nova] Creating event network-vif-unplugged:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:15:41.745534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-f4b0f5e9-613d-4cea-b96f-65b5e1c43c2b req-f05c949c-f14b-4c43-8fc6-83a2562aa2f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077168 Dec 15 14:15:41.746204 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 181/375] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:15:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:15:41.752943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:41.754132 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:41.761664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.761664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.761664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:41.761974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:41.904553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:41.911726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-205d94e3-c9f3-4548-940b-3681c9027ce3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1318 microversion: 2.1 time: 0.162683 Dec 15 14:15:41.912317 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 182/376] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:41 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:42.057186 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:42.057783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:42.064789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.065229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.065995 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.066424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.197589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:42.205753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9b4ea945-4440-4357-8695-47d4b239f36f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.152273 Dec 15 14:15:42.206310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 183/377] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:42 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:42.687108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ef9baf61-cbd6-4a8f-a0aa-e1c6225c4dd8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.159983 Dec 15 14:15:42.688934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 195/378] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Dec 15 14:15:41 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:15:42.820069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:42.820639 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:42.826626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.827083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.827860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.828317 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.928295 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:42.929009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:42.936027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.944215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:42.944215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:42.944215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.080821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.088395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4e9655d9-df17-45ee-a8f9-e5fa0e31b196 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1507 microversion: 2.1 time: 0.163692 Dec 15 14:15:43.090146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 196/379] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:42 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:43.141306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-cd0f3720-cf26-4ab2-9cbb-086e3d3d0b63 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action" status: 202 len: 0 microversion: 2.20 time: 0.325727 Dec 15 14:15:43.142259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 184/380] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:15:42 2021] POST /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:15:43.150266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:43.150864 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:43.159556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:43.159556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.159556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:43.159556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.225116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:43.226328 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:43.234461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:43.235081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.237745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:43.238558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:43.438121 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.448283 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.450070 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.452056 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6028deb7-3abd-4311-97ee-bf62a4ea410f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1749 microversion: 2.20 time: 0.305692 Dec 15 14:15:43.453426 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 197/381] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:43 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1749 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:43.515823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:43.523910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-64616c0f-8e60-44ac-a21f-e85d4917030b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.304396 Dec 15 14:15:43.524505 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 185/382] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:43 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:44.470849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:44.472141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:44.480104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.480553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.481345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.486304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.541892 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:44.542588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:44.549848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.550299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.551089 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:44.551546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:44.709066 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:44.720437 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:44.722927 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:44.725865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-80b74728-b9c6-4d83-a0f7-5f9d8f1de0b1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1749 microversion: 2.20 time: 0.257639 Dec 15 14:15:44.726924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 198/383] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:44 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:44.782564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:44.790855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ceb0923a-03bd-4bf5-93f2-c68de5964913 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.252626 Dec 15 14:15:44.791442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 186/384] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:44 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:45.751857 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:45.752507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:45.758684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.759158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.759947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.760394 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.807711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:45.808350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:45.817006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.817601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.818536 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:45.819078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:45.942822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:45.957141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:45.959320 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:45.960614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b3535de6-fd88-4c0c-80e0-a4f308884e25 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1751 microversion: 2.20 time: 0.213223 Dec 15 14:15:45.961461 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 199/385] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:45 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:46.002527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:46.010311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f1f147ec-f2d0-40be-9999-8c746306a078 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.206242 Dec 15 14:15:46.010867 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 187/386] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:45 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:46.982716 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:46.984054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:46.994379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:46.995009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:46.996154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:46.998479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.031117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:47.032299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:47.041178 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.041631 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.042635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.043247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.267540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.279703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.281315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.282477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-37208a7d-b1f2-42a1-84bf-70a24abed4d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1751 microversion: 2.20 time: 0.305627 Dec 15 14:15:47.283208 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 200/387] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:46 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:47.293285 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.294061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bba6b020-d3be-4617-8297-8efd43a6c99c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.268541 Dec 15 14:15:47.294626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 188/388] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:47 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:47.298861 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:15:47.301532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:47.306775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.307606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.308317 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.308867 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.333271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lazy-loading 'flavor' on Instance uuid 0055c3fd-c364-425b-a659-292f94e6f09c {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:15:47.570704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3563789e-ce95-4486-83b5-ae8e43aa049d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action" status: 200 len: 32 microversion: 2.1 time: 0.275605 Dec 15 14:15:47.576186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 201/389] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:15:47 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:15:47.584588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:47.585379 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:47.591739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.592220 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.593036 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:47.593470 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:47.761187 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:47.769517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c22c5786-b4d0-4dd4-a547-4b8ae33fb3cd tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.189261 Dec 15 14:15:47.770824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 189/390] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:47 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:48.405967 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:48.408143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:48.408143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:48.409588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:48.409685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.409685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.409685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.409685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.409976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.409976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.409976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.409976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.571380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:48.587458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:48.589285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:48.595082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:48.597396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-81106112-d218-4f1e-97aa-06be5378bd97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1751 microversion: 2.20 time: 0.298296 Dec 15 14:15:48.599473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7ea3881e-7350-4282-9244-62d95be4b97f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.284267 Dec 15 14:15:48.599473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 190/392] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:48 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:48.599991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 202/392] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:48 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1751 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:48.788952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:48.789496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:48.796970 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.797424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:48.798220 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:48.798664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.002371 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.010435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-af31a31f-7f02-410a-a777-0c12aa89992b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.225216 Dec 15 14:15:49.010840 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 191/393] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:48 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:49.617242 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:49.618452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:49.621929 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:49.629758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:49.629758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.629758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:49.629758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.631293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:49.642585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:49.643033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.643821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:49.644309 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:49.964013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.970674 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.979196 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e872c8c5-fb83-4ac1-a49b-4f51c1d196ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.361999 Dec 15 14:15:49.990798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 192/394] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:49 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:49.991717 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.993507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:49.994706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5e0b5352-a80a-488c-937e-b74f07d6d473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.381503 Dec 15 14:15:49.995277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 203/395] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:49 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:50.030047 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:50.032035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:50.039422 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:50.040482 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:50.041843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:50.042549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:50.219262 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:50.234976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e1f2e6ad-9f4c-4b2e-a163-dce75b3f88d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.204483 Dec 15 14:15:50.237312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 193/396] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:50 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:51.004608 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:51.006086 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:51.014553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.015298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:51.015780 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.020170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.020833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.024002 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:51.040696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.041148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.041944 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.043199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.423163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.431862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a73313cc-7f1a-4d77-9a84-4186f96609ca tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.437719 Dec 15 14:15:51.447506 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 204/397] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:50 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:51.486984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:51.488931 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:51.502224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.537611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.542591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.546319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.546736 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-876e0e5d-5c3d-425b-9200-4833ff1e62a7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.535546 Dec 15 14:15:51.557252 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 194/398] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:51 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:51.569778 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.570990 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:51.571641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:51.915200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:51.936870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-48a333c1-9829-4433-baff-666f9616ae13 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.474586 Dec 15 14:15:51.937350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 205/399] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:51 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:52.454935 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:52.455553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:52.468239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.468698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.473938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.474460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.566396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:52.567630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:52.577369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.579564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.585438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.588800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.837996 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:52.855175 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-627ec3c0-9621-452c-8edc-46125519fb33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.404850 Dec 15 14:15:52.857057 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 195/400] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:52 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:52.874463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:52.886352 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:52.889432 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:52.890906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e989f442-256f-4670-a577-072f1646a8e9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.328641 Dec 15 14:15:52.892068 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 206/401] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:52 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:52.955086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:52.956011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:52.964696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.965711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:52.967243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:52.967841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.189457 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:53.197291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3c774a6a-fc47-4b39-be37-5602a37f0ce9 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.246206 Dec 15 14:15:53.207317 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 196/402] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:52 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:53.873669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:53.874447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:53.882487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.884630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.885611 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.892833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.909445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:53.910056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:53.925951 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.926461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:53.927272 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:53.929025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:54.267903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:54.479156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-239d3bcd-5430-4ad4-a602-4e446baa90dd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.410797 Dec 15 14:15:54.479156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 207/403] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:53 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:54.479156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:54.479156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:54.479156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:54.488389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:54.488389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:54.488389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:54.490480 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:54.490480 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:54.491656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:54.491656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f14f5942-9f43-4092-a543-713ac8a23ed6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.491475 Dec 15 14:15:54.491656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 197/404] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:53 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:54.496669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:54.496669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-79f3a55f-32ec-4040-9a49-6959d003daaf tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.182755 Dec 15 14:15:54.496669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 208/405] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:54 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:55.483823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:55.490532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:55.491846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:55.492902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:55.504744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:55.508268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:55.508644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:55.509179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:55.509835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:55.510079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:55.510589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:55.510952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:55.959646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:55.976500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-514cf6fd-4d1d-427a-b547-96b521d4d0f6 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.489720 Dec 15 14:15:55.983688 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 209/406] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:55 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:55.993088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:55.993088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:56.005293 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:56.007637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:56.009105 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:56.011491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:56.082150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:56.099759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b1e12840-924e-4a88-a347-8ee90130b58c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.614324 Dec 15 14:15:56.099759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 198/407] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:55 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:56.324808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:56.334711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:56.336934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:56.338304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-baaac21f-5b1a-4d6d-a283-c993055b9451 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.353384 Dec 15 14:15:56.341182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 210/408] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:55 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:57.001790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:57.002566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:57.014347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.015746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.018524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.019809 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.116568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:57.117907 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:57.128350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.128800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.129593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.130024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.367006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.380197 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93c9d93e-bdc2-4d29-b9c9-90bf5783b633 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.383086 Dec 15 14:15:57.397047 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 199/409] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:56 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:57.409731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.412108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:57.415858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:57.418325 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4a0969f6-6ce2-4260-8430-0bd19f4b6057 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.305443 Dec 15 14:15:57.420752 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 211/410] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:57 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:57.438104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.438939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.440295 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:57.440957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:57.680350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.697829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.706367 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:57.709020 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5ecfacf0-d5ed-4eff-be81-47cb83711d3d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.309412 Dec 15 14:15:57.710289 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 200/411] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:57 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:15:58.400812 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:58.403305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:58.410062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.410510 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.411623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.412314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.437469 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:58.438917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:58.474206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.484740 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.487626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.492579 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.630952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.643361 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-76a6afe5-5668-4877-a23b-1e0e22c41dde tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.246195 Dec 15 14:15:58.643967 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 212/412] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:58 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:15:58.730812 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:58.741435 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:58.748229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.766123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3882333e-c6a3-4f97-8791-bdd4f836c40f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.333017 Dec 15 14:15:58.767178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.771729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.772775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:58.773216 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:58.776860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 201/413] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:58 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:15:58.945266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.962212 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.963783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:15:58.964996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cbffbbe5-7b6b-471d-8c99-c3f95fbc055b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.240066 Dec 15 14:15:58.980192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 213/414] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:15:58 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:15:59.661795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:59.662438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:59.681596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.682337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:59.683454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.684436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:59.786547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:15:59.787807 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:15:59.798052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.798753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:15:59.799726 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:15:59.815261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:00.093527 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:00.115897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-13f36bc3-dc6c-4889-9823-f69ecd45d0de tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.334367 Dec 15 14:16:00.117750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 214/415] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:59 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:00.125440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:00.126536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:00.145606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:00.146170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:00.146682 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:00.147816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:00.152566 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:00.155793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-74fcd1e2-d954-468d-a269-6127ab16920c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.497886 Dec 15 14:16:00.164974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 202/416] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:15:59 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:00.328776 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:00.341996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:00.344271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:00.345849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ffb2eb73-f7ba-4e6c-a5e4-5c29aa7b90e3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.225835 Dec 15 14:16:00.347893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 215/417] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:00 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:01.136042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:01.137510 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:01.146623 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.151042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.152199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.152857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.191749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:01.193016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:01.199114 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.217407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.217407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.217407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.544977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.556126 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5a782685-d20b-434a-af23-fed6709f343c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.374679 Dec 15 14:16:01.564000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 216/418] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:01 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:01.569081 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:01.569893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:01.576882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.577578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.577864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.578747 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:01.579342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:01.597966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f43f9c90-8e2a-4433-8f64-6b7ed988a8f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.464024 Dec 15 14:16:01.620101 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 203/419] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:01 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:01.860455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.869047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.870601 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:01.871970 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ded68c6b-8a89-4e57-9d91-a31ccd3f09f8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.306405 Dec 15 14:16:01.885934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 217/420] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:01 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:02.572589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:02.573898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:02.585143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.586035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.587053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.594712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.630459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:02.631967 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:02.646315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.646315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.646315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.646315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.866936 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:02.878352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-613b9bad-16e9-4818-a880-b96cf4ab93db tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.311577 Dec 15 14:16:02.879036 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 204/421] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:02 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:02.891619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:02.892374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:02.898326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.898866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:02.899719 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:02.900259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:03.020979 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:03.036960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a98f354b-f77e-4b64-ac81-13e63c714cbf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.409732 Dec 15 14:16:03.037774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 218/422] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:02 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:03.183689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:03.192610 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:03.194205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:03.195349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c6bb9202-d84a-46e7-8fad-03c07b68ac74 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.308520 Dec 15 14:16:03.197082 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 205/423] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:02 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:03.895677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:03.896309 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:03.903616 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:03.904388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:03.905567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:03.906240 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.058083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:04.061425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.063251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:04.077888 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c3a42e11-1c12-4e61-9580-c9ac1f0d1894 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.185934 Dec 15 14:16:04.090802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.090802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.090802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.091194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.092534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 219/424] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:03 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:04.217924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:04.219022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:04.226955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.229303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.229303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:04.229303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:04.250703 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.270608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-962204ca-5308-411b-ad6e-223f034deaf8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.216038 Dec 15 14:16:04.271214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 206/425] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:04 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:04.439914 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.455576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.457502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:04.458744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bc5df0e2-16ef-4876-a760-7a43368633c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.248054 Dec 15 14:16:04.459690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 220/426] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:04 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:05.096066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:05.096707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:05.105388 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.105850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.107292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.107738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.288387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:05.289644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:05.299323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.305341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.306667 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.307334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.308882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.319525 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0ba6eb71-7378-457a-b9b9-8ee544fcfc19 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.227325 Dec 15 14:16:05.320482 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 207/427] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:05 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:05.481616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:05.482589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:05.489205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.489776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.498491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.500653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:05.501244 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:05.507288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cfc55e23-400d-44c8-80e0-fd0aafef864f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1721 microversion: 2.1 time: 0.222647 Dec 15 14:16:05.517491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 221/428] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:05 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:05.673981 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.686095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.688918 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:05.690634 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-49203727-2f8a-4f36-bacc-94cda6b38dfd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.216325 Dec 15 14:16:05.702551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 208/429] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:05 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:06.336982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:06.338018 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:06.345933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.346377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.347158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.347772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.525824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:06.527386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:06.542454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.544062 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.545054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.545681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.624421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:06.646565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e454c2a4-89ca-4177-b977-6ce6803b7d42 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.313164 Dec 15 14:16:06.648494 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 222/430] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:06 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:06.708948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:06.709465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:06.717254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.717921 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.718860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.719438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.743357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:06.757964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-136fb63f-510c-4e45-870e-e1a86c850f54 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1698 microversion: 2.1 time: 0.236634 Dec 15 14:16:06.764382 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 209/431] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:06 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1698 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:06.775952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-097cd2ef-844d-44e3-a1a4-5551912a6321 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:06.787458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-097cd2ef-844d-44e3-a1a4-5551912a6321 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:06.787917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-097cd2ef-844d-44e3-a1a4-5551912a6321 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:06.834885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-097cd2ef-844d-44e3-a1a4-5551912a6321 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Going to try to start instance {{(pid=116681) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 14:16:06.932784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:06.959493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:06.961061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:06.962213 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-28520178-2181-4b1b-ad4f-ff0d8c6833b5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.257257 Dec 15 14:16:06.963292 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 223/432] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:06 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:07.473369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-097cd2ef-844d-44e3-a1a4-5551912a6321 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 202 len: 0 microversion: 2.1 time: 0.685387 Dec 15 14:16:07.473369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 210/433] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:06 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:16:07.473675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:07.473675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:07.475150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.475837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.484768 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.485606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.665685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:07.666597 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:07.676980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.677584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.678539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.679131 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.698250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:07.707779 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f9ce4755-1361-46e2-bd6a-859cccdaf090 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1707 microversion: 2.1 time: 0.245952 Dec 15 14:16:07.709009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 224/434] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:07 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1707 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:07.714151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bf28461-d840-46eb-b336-26079be0047c", "device": "/dev/sdb"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:07.716981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:07.726299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.726780 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.732909 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:07.733711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:07.988078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:07.999642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d4114d67-f410-4ff8-89a8-e63c794e230a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.338512 Dec 15 14:16:08.001070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 211/435] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:07 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:08.007760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:08.008402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:08.015458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.017471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.017471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.017471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.202676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:08.217859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:08.220957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:08.222504 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2eb61f34-c559-48a0-8d42-193b9603626c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.220332 Dec 15 14:16:08.223533 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 212/436] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:08 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:08.730745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:08.733155 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:08.744194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.745513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.747157 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:08.747868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:08.932906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:08.946970 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ec45553e-0676-4d05-a28b-dd5d29818312 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1707 microversion: 2.1 time: 0.224854 Dec 15 14:16:08.948021 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 213/437] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:08 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1707 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:09.018724 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:09.019858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:09.029479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.030307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.031328 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.032014 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.367098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:09.376730 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c1f1c611-4291-4c9e-bd8a-a4c23daa931d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.361845 Dec 15 14:16:09.377440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 214/438] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:09 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:09.391991 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:09.392635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:09.404896 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.405329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.406124 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:09.406556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:09.589144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:09.599034 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:09.601349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:09.602721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c8db4681-c4ae-4b43-b9e8-3fbc57a39c18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.223724 Dec 15 14:16:09.614336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 215/439] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:09 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:09.968158 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:10.028545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:10.028545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.028545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.028545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.029881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.128774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.140562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e6db5851-89c2-476a-b2ee-abd6aae9a6c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1707 microversion: 2.1 time: 0.177490 Dec 15 14:16:10.154416 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 216/440] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:09 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1707 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:10.393859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:10.394519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:10.401017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.401708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.403454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.404280 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.553852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.563002 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a1187972-477d-4aeb-bf39-ef24aa601c1d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.172776 Dec 15 14:16:10.563692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 217/441] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:10 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:10.622087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:10.622699 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:10.628664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.629127 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.629959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:10.630428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:10.784683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.794087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.796900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:10.798076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-53417088-532d-4a3d-99b4-114f811cc82c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.180247 Dec 15 14:16:10.798642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 218/442] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:10 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:16:11.160193 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:11.160983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:11.170811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.172938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.175334 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.175334 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.428197 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:11.439303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e95f3df6-b696-4f18-9a05-21dc27772afa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1707 microversion: 2.1 time: 0.284406 Dec 15 14:16:11.440578 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 219/443] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:11 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1707 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:11.572316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-afba6e71-528d-40f4-b692-069e91986324 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "POST /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.861685 Dec 15 14:16:11.580059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 225/444] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:16:07 2021] POST /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb/os-volume_attachments => generated 194 bytes in 3870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:11.582958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:11.583573 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:11.593664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.594516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.595496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.596143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.818806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:11.821409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:11.828279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.828729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.829517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:11.830143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:11.976147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:11.990518 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9bc0eacd-a134-4e91-9e5f-e3e783334c66 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.413955 Dec 15 14:16:11.991092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 220/445] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:11 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:12.068284 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:12.078471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:12.080389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:12.081851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5a77269b-2358-4087-aecc-5eb3c099bf8c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.269042 Dec 15 14:16:12.082500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 226/446] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:11 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:16:12.456557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:12.457815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:12.465894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:12.466586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:12.467501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:12.468083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:12.618045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:12.626882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-12e1f7fb-ad2f-40b4-b4c4-3a2b84bfa524 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1707 microversion: 2.1 time: 0.174254 Dec 15 14:16:12.627901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 221/447] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:12 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:13.009115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:13.009736 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:13.015825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.016533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.017651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.018187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.101122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:13.101774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:13.117601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.118061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.118852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.119288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.263502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:13.275777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f13f2883-470c-4e51-bcff-36d411d9ae4d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.271039 Dec 15 14:16:13.276419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 227/448] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:13 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:13.336072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:13.345202 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:13.347246 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:13.374491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8d17e1aa-8513-4a9c-b909-5f7f45ca8447 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.252107 Dec 15 14:16:13.374491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 222/449] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:13 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:13.643240 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:13.643772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:13.649654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.650089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.650845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:13.651267 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:13.798867 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:13.807627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1e80fe1d-0ea2-4179-8d95-96a0e8d92e69 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1711 microversion: 2.1 time: 0.168231 Dec 15 14:16:13.818758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 228/450] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:13 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1711 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:14.306286 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:14.307101 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:14.335853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.338418 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.339243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.340023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.392464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:14.393396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:14.406192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.407348 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.408612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:14.409224 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:14.648411 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:14.660549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b8e258e6-b52d-4737-a8c3-884ee756ce54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.366068 Dec 15 14:16:14.661800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 223/451] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:14 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:14.677756 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:14.687681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:14.689335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:14.690772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-85f5c995-e333-421f-aef1-44bcca0a201f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.304109 Dec 15 14:16:14.691540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 229/452] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:14 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:15.678693 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:15.679937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:15.687682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.688219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.690249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.690249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.710941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:15.712211 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:15.726884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.727871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.729142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:15.729142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:15.947522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:15.950872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:15.959053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fc4cde96-2c21-4480-b790-9d54f5ef58f4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.281404 Dec 15 14:16:15.959475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:15.960757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:15.962730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a88df233-a666-4063-8b5d-e321c7b440ec tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.256634 Dec 15 14:16:15.973712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 230/453] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:15 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:16:15.976647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 224/454] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:15 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:16.181877 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-4b43ffa9-e6d2-4266-a9b0-aee3b77b5e6e req-32164ad6-2ba5-4ea1-aaa7-7f2e4f5babc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "name": "network-vif-plugged", "status": "completed", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:16.187028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:16.187028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:16:16.194940 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b43ffa9-e6d2-4266-a9b0-aee3b77b5e6e req-32164ad6-2ba5-4ea1-aaa7-7f2e4f5babc7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.195448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b43ffa9-e6d2-4266-a9b0-aee3b77b5e6e req-32164ad6-2ba5-4ea1-aaa7-7f2e4f5babc7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.209105 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-4b43ffa9-e6d2-4266-a9b0-aee3b77b5e6e req-32164ad6-2ba5-4ea1-aaa7-7f2e4f5babc7 service nova] Creating event network-vif-plugged:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:16:16.214530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-4b43ffa9-e6d2-4266-a9b0-aee3b77b5e6e req-32164ad6-2ba5-4ea1-aaa7-7f2e4f5babc7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037255 Dec 15 14:16:16.215721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 231/455] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:16.977227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:16.977842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:16.984954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:16.985484 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.985638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:16.985936 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.986722 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.987190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.992062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.992502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:16.993266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:16.993691 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:17.185213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:17.192529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:17.193020 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6563dee9-e2d5-4f27-8a84-87e6a005af54 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.219862 Dec 15 14:16:17.193590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 225/456] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:16 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:17.201584 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:17.203075 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:17.204245 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d7d22380-7685-4c58-bcaa-31a025cdede6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.223930 Dec 15 14:16:17.204796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 232/457] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:16 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:18.210494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:18.213950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:18.214064 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'create', calling method: .version_select at 0x7f9cbec729d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-549090501"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:18.218969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.219492 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.220294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.220737 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.227639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:18.231674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for user b150c32b905548ed83d3326596f88c57 and project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:18.243167 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [6311383c-630d-4a23-b229-a0ec2be80a43] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:16:18.356239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:18.363951 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c0865ed3-381d-4b47-9068-a90c58dc9a4a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.157324 Dec 15 14:16:18.364530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 226/458] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:18 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:18.368770 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:18.369364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:18.377158 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.377606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.378397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:18.378810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:18.508689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:18.518275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:18.519814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:18.521014 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2cb2c071-cabf-493a-b8fd-81aa561f40c9 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.155588 Dec 15 14:16:18.521568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 227/459] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:18 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:19.259518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [6311383c-630d-4a23-b229-a0ec2be80a43] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38742. Dec 15 14:16:19.380551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:19.381228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:19.387751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.388257 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.389030 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.389461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.522127 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.530452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-62bbf5a6-8c37-48e3-8efc-4c911f82340d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.153831 Dec 15 14:16:19.531005 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 228/460] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:19 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:19.539491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:19.540137 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:19.546762 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.547205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.548048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:19.548483 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:19.561020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:19.564671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for user b150c32b905548ed83d3326596f88c57 and project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:19.577621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fea01511-2ddd-4394-9d8f-7dcf8ee6cc66 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.369756 Dec 15 14:16:19.578225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 233/461] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 14:16:18 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:19.627640 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-33755976", "imageRef": "d9d92cfd-007c-4831-a95d-fceb9994afca", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-549090501", "networks": [{"uuid": "0ab8db93-01e2-4a13-a31c-081ad8890766"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:19.679590 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] validate_networks() for [('0ab8db93-01e2-4a13-a31c-081ad8890766', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:16:19.682817 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.691652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.693260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:19.695955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-db0bcc94-1c72-4110-b427-74d1e08d3c87 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.158591 Dec 15 14:16:19.702523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 229/462] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:19 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:16:20.047005 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:16:20.047549 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:16:20.048050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:16:20.048453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:16:20.048855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:16:20.057401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.057838 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.058626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.059558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.076749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:20.080716 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Getting quotas for user b150c32b905548ed83d3326596f88c57 and project 9ed188fb44624c1b86723b0a0cf261c5. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:20.092263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:16:20.094828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d9d92cfd-007c-4831-a95d-fceb9994afca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:16:20.240301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [0b523e48-4bbc-4e7c-9a51-8447b9463bad] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 14:16:20.547432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:20.548107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:20.554482 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.554947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.555709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.556161 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.717163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.724872 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eb158567-b717-4663-9ec4-b3c9c933f2e8 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1567 microversion: 2.1 time: 0.181660 Dec 15 14:16:20.725442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 230/463] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:20 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:20.730085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:20.730678 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:20.737315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.737759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.738531 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:20.738999 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:20.906779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.916218 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.917791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:20.919570 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ec37c33e-f88f-4dae-8bd6-460f1e449651 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.192858 Dec 15 14:16:20.920169 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 231/464] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:20 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:21.256587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [0b523e48-4bbc-4e7c-9a51-8447b9463bad] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38772. Dec 15 14:16:21.260884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d38c9c7e-2acb-4d15-bf88-07c707f7db18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637087 Dec 15 14:16:21.267073 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 234/465] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:16:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:16:21.271876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9a4e9291-a3b2-4e2a-8f91-bf3e569a1c6e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.272676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9a4e9291-a3b2-4e2a-8f91-bf3e569a1c6e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.341656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9a4e9291-a3b2-4e2a-8f91-bf3e569a1c6e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:21.347678 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9a4e9291-a3b2-4e2a-8f91-bf3e569a1c6e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1256 microversion: 2.1 time: 0.079424 Dec 15 14:16:21.348510 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 232/466] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:21 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1256 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:21.742402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.743014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.751107 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.759251 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.759251 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.759251 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.891772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:21.899688 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3cb8cac3-2355-4f18-99ee-56dea9995a33 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1547 microversion: 2.1 time: 0.160929 Dec 15 14:16:21.900369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 235/467] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:21 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:21.917371 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.917931 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.928734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.929488 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.930804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.931539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.938242 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:21.938855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:21.944953 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.945401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:21.946250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:21.946690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.152294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:22.163820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] HTTP exception thrown: Cannot 'detach_volume' instance 0055c3fd-c364-425b-a659-292f94e6f09c while it is in vm_state rescued Dec 15 14:16:22.164922 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Returning 409 to user: Cannot 'detach_volume' instance 0055c3fd-c364-425b-a659-292f94e6f09c while it is in vm_state rescued {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:16:22.168114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e900690b-54f0-41d2-b08d-be9ee4571566 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments/0ad2b327-3989-4640-8e80-faa0b67ad9de" status: 409 len: 152 microversion: 2.1 time: 0.254815 Dec 15 14:16:22.169812 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 233/468] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:16:21 2021] DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments/0ad2b327-3989-4640-8e80-faa0b67ad9de => generated 152 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 14:16:22.174899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:22.184915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:22.184915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b72f97ab-efe4-433f-8112-f677a1ad66e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.249567 Dec 15 14:16:22.186542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:22.187691 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 236/469] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:21 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:16:22.188372 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:22.197242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.197933 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.199194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.202556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.364539 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b6acdf3e-1959-4d92-add9-800b3deb78b1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:22.365732 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b6acdf3e-1959-4d92-add9-800b3deb78b1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:22.422720 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6acdf3e-1959-4d92-add9-800b3deb78b1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:22.429400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b6acdf3e-1959-4d92-add9-800b3deb78b1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1256 microversion: 2.1 time: 0.068353 Dec 15 14:16:22.433129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 237/470] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:22 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:22.483312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-10a0da40-8581-4581-acbe-90b089bad019 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action" status: 202 len: 0 microversion: 2.1 time: 0.306940 Dec 15 14:16:22.485974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 234/471] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:16:22 2021] POST /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:16:22.492264 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:22.492957 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:22.505125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.505125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.505125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:22.505125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:22.657477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:22.665792 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f9e8cb63-e6c9-465a-930b-0935301f5d5e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.177389 Dec 15 14:16:22.666533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 238/472] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:22 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:23.206520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:23.207254 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:23.213346 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.213797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.214583 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.215022 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.346937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.355496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.357721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.360606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-09654f15-9eec-425d-8436-4f992fb75ae3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.157022 Dec 15 14:16:23.360606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 235/473] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:23 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:23.446015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:23.446719 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:23.454509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.455074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.455969 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.456472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.525623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.534170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-02065d33-af99-435b-b686-89cd68b29a49 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1308 microversion: 2.1 time: 0.091928 Dec 15 14:16:23.535531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 239/474] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:23 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:23.683980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:23.684588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:23.690565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.691011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.691789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:23.692248 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:23.839455 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:23.847975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c9f5a3a0-2b69-4ad3-9f98-999c5f897baa tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.167642 Dec 15 14:16:23.848555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 236/475] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:23 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:24.378137 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:24.378685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:24.384565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.385000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.385762 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.386183 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.518870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:24.527110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:24.529226 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:24.530354 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-11486ccb-32b8-42f2-a627-4d4adea5b3cd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.156117 Dec 15 14:16:24.530909 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 240/476] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:24 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:24.551808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:24.552587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:24.558759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.559456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.560071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.560526 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.618038 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:24.625169 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-791fbcd6-e296-458d-a124-17cd89b66c13 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1308 microversion: 2.1 time: 0.077041 Dec 15 14:16:24.625728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 237/477] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:24 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1308 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:24.869800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:24.870429 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:24.876412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.876858 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:24.877638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:24.878068 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.015575 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.023383 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c1ad1c06-7cba-4982-b34c-56c24166e1d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.157231 Dec 15 14:16:25.023961 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 241/478] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:24 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:25.547940 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:25.548473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:25.554295 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.554885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.555524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.556050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.642555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:25.643191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:25.649522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.649972 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.650754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:25.651186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:25.698785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.707338 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.708935 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.710065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6b4d50cc-1ec7-443e-a15e-0579562234dd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.166058 Dec 15 14:16:25.710626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 238/479] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:25 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:25.713121 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:25.720628 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ddc60ac8-fb56-4e89-bf8a-d5fbef94b2f7 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1308 microversion: 2.1 time: 0.081789 Dec 15 14:16:25.721192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 242/480] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:25 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1308 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:26.041722 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:26.041950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:26.050266 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.050906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.051855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.052314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.186563 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.194167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-135d38aa-7fa6-448e-a864-f6a4bc8b640b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.156953 Dec 15 14:16:26.194716 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 239/481] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:26 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:26.728259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:26.728900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:26.735301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.742357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.742357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.742357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.742622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:26.742622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:26.744645 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.745228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.746538 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:26.746538 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:26.827591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.836109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ff0b27cf-da76-413c-9e47-c305747f89c0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1308 microversion: 2.1 time: 0.102357 Dec 15 14:16:26.836684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 240/482] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:26 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:26.897499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.907203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.909200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:26.910042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-dd4168cf-9f59-4f5e-bafa-edbc320ec20a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1807 microversion: 2.20 time: 0.185820 Dec 15 14:16:26.910592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 243/483] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:26 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:27.211633 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:27.212276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:27.218213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.218669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.219484 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.219941 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.369535 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:27.378526 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-579f97c5-592e-48f9-81f9-7c7af792118e tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.170644 Dec 15 14:16:27.388249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 241/484] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:27 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:27.854119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:27.854775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:27.862718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.872786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.874005 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.874598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.928507 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:27.929227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:27.942623 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.943071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:27.946912 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:27.947590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.229098 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.237481 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e5a76fc2-8897-477b-a783-3369ef927d1a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.387510 Dec 15 14:16:28.242991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 244/485] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:27 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:28.259104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.269947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.271856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.273224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-13df46d1-9c1c-4727-94d7-60f83be35512 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1794 microversion: 2.20 time: 0.348417 Dec 15 14:16:28.274583 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 242/486] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:16:27 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1794 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:16:28.397797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:28.399872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:28.408777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:28.408777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.408777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:28.408777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:28.556444 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:28.565239 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3437e51c-d9d9-424e-bec8-3b82f8875560 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.172490 Dec 15 14:16:28.565800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 245/487] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:28 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:29.263100 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:29.264110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:29.271097 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.271630 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.272518 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.273029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.419948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:29.427111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7ce4d47c-1be0-48d3-82fa-eebfaf96ae28 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.167829 Dec 15 14:16:29.427681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 243/488] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:29 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:29.583485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:29.584125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:29.590345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.590790 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.591623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:29.592088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:29.733049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:29.740890 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-30a962f8-abca-4e18-9b7d-380ef6b8ae35 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.161075 Dec 15 14:16:29.745676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 246/489] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:29 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:30.443951 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:30.444577 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:30.451598 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.452069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.452836 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.453264 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.596459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:30.604531 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-80197438-698e-409e-b308-098f69a4468e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.164049 Dec 15 14:16:30.605109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 244/490] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:30 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:30.759641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:30.760186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:30.767195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.767893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.768876 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:30.769495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:30.897745 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:30.905952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9f907392-6927-485f-8d54-050f347fecf3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.150254 Dec 15 14:16:30.906511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 247/491] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:30 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:31.622834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:31.628142 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:31.630263 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.630715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.631498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.631950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.770991 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:31.779156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-12f2c750-0f15-4c01-9bc3-d9f1c9542f9e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.159865 Dec 15 14:16:31.779747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 245/492] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:31 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:31.923110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:31.923689 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:31.930035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.930478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:31.931243 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:31.931668 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.096865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:32.107151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-de8d11a1-f58e-45ff-bf8a-61df93af24b2 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.187173 Dec 15 14:16:32.118396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 248/493] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:31 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:32.796648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:32.797311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:32.803743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:32.804232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.805004 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:32.805440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:32.945959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:32.953719 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bd85bc69-d5a9-4c2d-8d49-d069cd43407a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.161429 Dec 15 14:16:32.954300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 246/494] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:32 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:33.125858 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:33.127333 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:33.134704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.135647 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.137065 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.138409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.280310 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:33.287882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-eadbb779-77d8-412f-b01b-1630a9b20945 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.166007 Dec 15 14:16:33.288469 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 249/495] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:33 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:33.970733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:33.971355 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:33.977829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.978271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:33.979062 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:33.979519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.117135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:34.125763 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e3801397-24c0-402d-92b2-19567a377d85 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.158659 Dec 15 14:16:34.126368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 247/496] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:33 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:34.305084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:34.305625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:34.311875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.312349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.313115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:34.313539 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:34.449167 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:34.457286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6ce92dc6-767b-41af-a882-2cbc9eb5ce8a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.155898 Dec 15 14:16:34.457862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 250/497] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:34 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:35.143048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:35.143048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:35.149399 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.150135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.151244 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.151833 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.286881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:35.294925 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1ece8b80-cee2-41a3-9259-697c4768b11b tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.156241 Dec 15 14:16:35.295606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 248/498] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:35 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:35.475565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:35.476534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:35.483652 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.484155 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.484921 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:35.485350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:35.852170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:35.861173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f88b463b-43ea-445c-8852-bcf0d33f304a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.389220 Dec 15 14:16:35.861955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 251/499] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:35 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:36.311682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:36.312151 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:36.318689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.319144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.319949 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.320385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.454717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:36.462198 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f299dbce-94f8-4f7d-b8d7-3a4dc6069e7c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.154585 Dec 15 14:16:36.473011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 249/500] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:36 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:36.879377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:36.879995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:36.886572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.887019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:36.889039 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:36.889763 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.034377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:37.042341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9bc6f6d2-53a9-4a62-9809-e3559202b515 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.166745 Dec 15 14:16:37.042944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 252/501] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:36 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:37.481068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:37.482998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:37.489398 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:37.489839 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.490637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:37.491067 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:37.621224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:37.629892 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-87dcf58a-bb4f-4dfd-a866-316bb5237b43 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.152601 Dec 15 14:16:37.630523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 250/502] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:37 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:38.060773 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:38.066760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:38.067522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.068067 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.068852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.069288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.202634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:38.210478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8d2c1b91-d402-498a-b8c8-d0786e5a8ba4 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.153654 Dec 15 14:16:38.211026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 253/503] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:38 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:38.647228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:38.647827 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:38.655093 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.655636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.656456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:38.656898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:38.797997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:38.805512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c735165e-62b0-416a-92c1-23d4b46dafdf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.161886 Dec 15 14:16:38.806098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 251/504] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:38 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:39.230381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:39.231757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:39.238129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.238922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.239746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.240190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.380408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:39.388634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cf8f1243-c82c-4ca9-9c72-5688951b8218 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.164047 Dec 15 14:16:39.393541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 254/505] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:39 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:39.823133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:39.823858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:39.830399 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.830842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.831609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.832066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.869731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:39.870217 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:39.879341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.880089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.881066 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:39.881660 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:39.985683 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:39.993424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-271caac2-976c-48a3-8c9d-b49773a20d4e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.173968 Dec 15 14:16:39.994106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 252/506] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:39 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:40.016774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lazy-loading 'services' on Instance uuid ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:16:40.366038 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4a621757-6752-4ff5-bfa9-d92e2d642292 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb/os-volume_attachments/8bf28461-d840-46eb-b336-26079be0047c" status: 202 len: 0 microversion: 2.1 time: 0.499995 Dec 15 14:16:40.366686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 255/507] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:16:39 2021] DELETE /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb/os-volume_attachments/8bf28461-d840-46eb-b336-26079be0047c => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:16:40.406060 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:40.406680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:40.419520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.420009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.420819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:40.421249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:40.554570 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:40.562920 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-145eea9d-688e-4b51-aceb-d1ccfc837856 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.161018 Dec 15 14:16:40.563478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 253/508] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:40 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:40.773128 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:16:40.773336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:16:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:16:41.012214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:41.013128 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:41.019656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.020227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.021006 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.021440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.279655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:41.286919 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-eb796cb9-42b6-49fd-ae25-556c5ea318d0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.279212 Dec 15 14:16:41.287484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 256/509] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:41 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:41.580886 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:41.581646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:41.589060 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.589427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.590300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.591103 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.773691 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:41.783902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3aef3030-6050-40b3-bdc0-327a0013e3df tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1555 microversion: 2.1 time: 0.207227 Dec 15 14:16:41.784819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 254/510] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:41 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1555 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:41.802184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-2325745f-bd66-4d19-8ed2-731555fe821f req-de3a3030-4522-4602-ac0d-d9de6c893af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:41.803970 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:41.803970 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:16:41.812252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-2325745f-bd66-4d19-8ed2-731555fe821f req-de3a3030-4522-4602-ac0d-d9de6c893af3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:41.813023 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-2325745f-bd66-4d19-8ed2-731555fe821f req-de3a3030-4522-4602-ac0d-d9de6c893af3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:41.830004 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-2325745f-bd66-4d19-8ed2-731555fe821f req-de3a3030-4522-4602-ac0d-d9de6c893af3 service nova] Creating event network-changed:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:16:41.833232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-2325745f-bd66-4d19-8ed2-731555fe821f req-de3a3030-4522-4602-ac0d-d9de6c893af3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034837 Dec 15 14:16:41.833854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 257/511] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:42.304689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:42.305301 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:42.311685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.312170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.312952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.313401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.506997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:42.514254 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e59aa277-af41-4ec0-b703-4d4f4bd26773 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.213221 Dec 15 14:16:42.514827 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 255/512] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:42 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:42.564376 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:42.564951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:42.570947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.571384 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.572175 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.572604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.598523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:16:42.801098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:42.801707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:42.807897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.808371 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.815448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.815448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.921649 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ebe36653-4265-467a-b8de-17b042e86284 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 204 len: 0 microversion: 2.1 time: 0.362034 Dec 15 14:16:42.922338 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 258/513] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:16:42 2021] DELETE /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:16:42.930651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:42.931332 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:42.937955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.938394 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.939158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:42.939579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:42.945339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:42.953907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-56c10701-825d-4231-bdd3-002baa9fb65d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1561 microversion: 2.1 time: 0.156402 Dec 15 14:16:42.954486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 256/514] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:42 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:43.020746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:43.021324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:43.027303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.027821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.029919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.030423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.077012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:43.084612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-57dd03f4-aaa6-4e59-89db-f4730e36aada tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1513 microversion: 2.1 time: 0.157996 Dec 15 14:16:43.085187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 259/515] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:42 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:43.111251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lazy-loading 'services' on Instance uuid 0055c3fd-c364-425b-a659-292f94e6f09c {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:16:43.354396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-25eca09c-423d-408b-9eca-0013dc27c25a tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments/0ad2b327-3989-4640-8e80-faa0b67ad9de" status: 202 len: 0 microversion: 2.1 time: 0.337273 Dec 15 14:16:43.354938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 257/516] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:16:43 2021] DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments/0ad2b327-3989-4640-8e80-faa0b67ad9de => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:16:43.363412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:43.364906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:43.370370 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.370804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.371568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.372544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.401280 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b86ad6a3-1afc-4dc1-9992-99f89c0564b0 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 Dec 15 14:16:43.401828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 260/517] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:16:43 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:43.531429 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:43.532162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:43.538137 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.538570 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.539343 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:43.539774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:43.671521 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:43.678652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5a4ad3f5-463c-417b-b91e-134329adbb0a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.151262 Dec 15 14:16:43.679216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 258/518] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:43 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:44.102309 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:44.102920 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:44.109817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.110304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.111078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.111510 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.242009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:44.249536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-76a9e1d8-bc94-4d52-8210-89468c14d839 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1513 microversion: 2.1 time: 0.151342 Dec 15 14:16:44.250103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 261/519] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:44 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:44.413043 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:44.414035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:44.421069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.421591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.422369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.422799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.453117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5e249683-05d2-4e47-a0eb-990553eb6676 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Dec 15 14:16:44.453755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 259/520] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:16:44 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:44.695387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:44.695908 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:44.702017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.702456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.703211 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:44.703643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:44.834390 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:44.841906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1beaeac9-e11b-44b8-b126-f92874122752 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.150389 Dec 15 14:16:44.842473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 262/521] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:44 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:45.266318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:45.266926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:45.272745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.273196 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.273977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.274788 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.465232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:45.466901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:45.472958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.473398 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.474246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.474672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.495636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:45.504687 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-008bef08-3df3-4a17-8c25-e4b5f9ed366d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1513 microversion: 2.1 time: 0.242009 Dec 15 14:16:45.505271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 260/522] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:45 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:45.512047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e67a82ec-e064-4cec-a80e-9d781ba3b0a7 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050974 Dec 15 14:16:45.512760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 263/523] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:16:45 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:16:45.858839 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:45.859444 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:45.865518 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.870069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:45.870069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:45.870069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.012263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-8dd15d96-2db3-492c-a5b0-5cb727b04afc req-a1708127-94d9-43cb-849e-4cbd6c4b54b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb", "name": "network-vif-deleted", "tag": "b113c35c-4ca3-4037-96fb-e527b48590e0"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:46.014746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:46.014746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:16:46.022914 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-8dd15d96-2db3-492c-a5b0-5cb727b04afc req-a1708127-94d9-43cb-849e-4cbd6c4b54b1 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.023339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-8dd15d96-2db3-492c-a5b0-5cb727b04afc req-a1708127-94d9-43cb-849e-4cbd6c4b54b1 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.035232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-8dd15d96-2db3-492c-a5b0-5cb727b04afc req-a1708127-94d9-43cb-849e-4cbd6c4b54b1 service nova] Creating event network-vif-deleted:b113c35c-4ca3-4037-96fb-e527b48590e0 for instance ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb on hv-cinder-81322 Dec 15 14:16:46.040132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-8dd15d96-2db3-492c-a5b0-5cb727b04afc req-a1708127-94d9-43cb-849e-4cbd6c4b54b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Dec 15 14:16:46.040939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 264/524] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:16:46.086092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:46.094395 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d9d3bd68-7500-46c9-9f36-7cfa499cc6cd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.240069 Dec 15 14:16:46.094969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 261/525] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:45 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:46.523341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:46.524113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:46.530243 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.530724 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.531496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.531959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.563351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:46.564036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:46.564586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lazy-loading 'fault' on Instance uuid ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:16:46.609368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:46.616834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8408e866-6983-489f-a238-e030384bfc4d tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 200 len: 1308 microversion: 2.1 time: 0.097943 Dec 15 14:16:46.617400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 265/526] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:46 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:47.111708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:47.112363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:47.118838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.119288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.120093 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.120528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.250899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:47.258054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-746aa78c-0979-4249-a636-4964b8f55fd2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.150059 Dec 15 14:16:47.259801 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 262/527] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:47 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:47.640960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:47.641487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:47.647729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.648204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.648962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:47.649387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:47.662282 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] HTTP exception thrown: Instance ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb could not be found. Dec 15 14:16:47.662860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Returning 404 to user: Instance ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:16:47.663655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f2689553-ac16-48a3-b82f-a9deea675f69 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb" status: 404 len: 111 microversion: 2.1 time: 0.026757 Dec 15 14:16:47.664205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 266/528] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:47 2021] GET /compute/v2.1/servers/ed2b4c01-15d6-4724-bd88-3a6ef14dc9bb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:16:48.275941 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:48.276678 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:48.283803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.284293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.285072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.285528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.369788 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:48.370580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:48.376821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.377263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.378034 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.378671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.404465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:16:48.430829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:48.439362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7b8e8f92-d33a-461e-ac53-ab9dcaf1e958 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.167092 Dec 15 14:16:48.439977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 263/529] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:48 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:48.452067 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-33c3aee1-f539-4c4a-b342-8399a0a40dcb req-2ba4cc39-308b-49ef-8d50-e2b7e6494a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "name": "network-vif-plugged", "status": "completed", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:48.453755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:48.453755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:16:48.460711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-33c3aee1-f539-4c4a-b342-8399a0a40dcb req-2ba4cc39-308b-49ef-8d50-e2b7e6494a40 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.461094 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-33c3aee1-f539-4c4a-b342-8399a0a40dcb req-2ba4cc39-308b-49ef-8d50-e2b7e6494a40 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.472007 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-33c3aee1-f539-4c4a-b342-8399a0a40dcb req-2ba4cc39-308b-49ef-8d50-e2b7e6494a40 service nova] Creating event network-vif-plugged:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:16:48.477055 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-33c3aee1-f539-4c4a-b342-8399a0a40dcb req-2ba4cc39-308b-49ef-8d50-e2b7e6494a40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029535 Dec 15 14:16:48.477622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 264/530] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:48.672586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-77315dc5-6c61-4656-b523-c6d764d04820 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 204 len: 0 microversion: 2.1 time: 0.306176 Dec 15 14:16:48.673173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 267/531] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:16:48 2021] DELETE /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 14:16:48.681643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:48.682369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:48.699831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.699831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.699831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:48.699831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:48.818456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:48.826028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-767dedb3-e964-49ce-a604-9f8bb6dc5c4b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.148067 Dec 15 14:16:48.826592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 265/532] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:48 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:49.456885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:49.457568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:49.463477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.463913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.464708 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.465130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.603106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:49.610825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-86526c58-c9a6-4e18-86cf-df4d266e2bc8 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.158056 Dec 15 14:16:49.611387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 268/533] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:49 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:49.842442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:49.843043 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:49.849357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.849804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.850575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:49.851007 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:49.979895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:49.987803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-badd6e0a-2380-46d9-b8ce-93ad5271f9c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.149095 Dec 15 14:16:49.988397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 266/534] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:49 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:50.627335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:50.627955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:50.634184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.634621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.635378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:50.635836 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:50.767202 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:50.774266 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8fa17b19-2a31-4bab-88a8-11ca1b89f5d1 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.150610 Dec 15 14:16:50.774831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 269/535] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:50 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:51.005216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:51.005831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:51.012165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.013177 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.013976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.014411 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.147756 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:51.154949 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a9ba4f94-b4d7-4d2e-bc31-7e38bba27e87 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.153502 Dec 15 14:16:51.155511 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 267/536] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:51 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:51.791072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:51.791671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:51.798630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.799077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.799840 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:51.800289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:51.929520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:51.936577 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bdfb7d76-fa28-4d7f-9b87-64d5cc1af767 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1356 microversion: 2.1 time: 0.149215 Dec 15 14:16:51.937142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 270/537] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:51 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:52.173860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:52.174474 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:52.180779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.181229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.182006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.182442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.317686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:52.324911 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0cab8001-168e-4c7f-8e83-3531df6ccdba tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.154752 Dec 15 14:16:52.326139 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 268/538] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:52 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:52.953862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:52.954546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:52.961015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.961517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:52.962279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:52.962706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.094734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.102335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-691d1e22-a660-4547-a99a-5b7ba85e6fee tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1546 microversion: 2.1 time: 0.152644 Dec 15 14:16:53.102898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 271/539] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:52 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:53.119591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:53.120232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:53.126408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.126847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.127614 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.128079 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.255200 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.262861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-809ed067-82be-41ea-a486-a34e74eea869 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1546 microversion: 2.1 time: 0.146769 Dec 15 14:16:53.263599 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 269/540] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:53 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:53.279083 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:53.282503 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:53.282503 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:16:53.283483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.284252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Searching by: {'deleted': False, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5'} {{(pid=116680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 14:16:53.290655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.291096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.291891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.292374 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.342881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:53.343492 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:53.349423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.349877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.350657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.351342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.380470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.multi_cell_list [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 14:16:53.476404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-056229ad-9264-43ef-a681-22329dbaffc3 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.201039 Dec 15 14:16:53.477225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 272/541] 10.222.0.36 () {58 vars in 1124 bytes} [Wed Dec 15 14:16:53 2021] GET /compute/v2.1/servers => generated 341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:53.479508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.487085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:53.487521 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-53c1e378-6a3c-4cba-b5ba-2097c0dbd18c tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.148823 Dec 15 14:16:53.487687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:53.488114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 270/542] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:53 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:53.493395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.493839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.494607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:53.495039 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:53.627363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:53.634729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-665107d5-99c1-4cdb-8e23-7c8e533d78ff tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1546 microversion: 2.1 time: 0.151181 Dec 15 14:16:53.635290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 273/543] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:53 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:16:54.505219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:54.505823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:54.512154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.512640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.513428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.513862 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.717983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:54.725268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-695a50a1-d216-4695-aecd-2b87e78b7e57 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1508 microversion: 2.1 time: 0.224114 Dec 15 14:16:54.725831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 271/544] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:54 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:54.886661 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-4b667d18-0911-435d-ad34-1840c4ff0ec2 req-39ab7133-f85f-4c3f-90fe-cdc5a2b792e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f88386-a08e-43b7-9832-f7932c369cd9", "name": "network-vif-deleted", "tag": "ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:54.888906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:16:54.888906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:16:54.896065 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b667d18-0911-435d-ad34-1840c4ff0ec2 req-39ab7133-f85f-4c3f-90fe-cdc5a2b792e7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:54.896501 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b667d18-0911-435d-ad34-1840c4ff0ec2 req-39ab7133-f85f-4c3f-90fe-cdc5a2b792e7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:54.907260 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-4b667d18-0911-435d-ad34-1840c4ff0ec2 req-39ab7133-f85f-4c3f-90fe-cdc5a2b792e7 service nova] Creating event network-vif-deleted:ffbfa64b-6cf8-43f1-ab9f-4f58a0e48529 for instance f8f88386-a08e-43b7-9832-f7932c369cd9 on hv-cinder-81322 Dec 15 14:16:54.912387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-4b667d18-0911-435d-ad34-1840c4ff0ec2 req-39ab7133-f85f-4c3f-90fe-cdc5a2b792e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029238 Dec 15 14:16:54.912987 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 274/545] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:55.742391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:55.743012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:55.750116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:55.750557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:55.751323 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:55.751752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:55.811377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:55.818477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fae876f9-3f86-449a-810f-93a6d7ea66d3 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1466 microversion: 2.1 time: 0.079853 Dec 15 14:16:55.819033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 272/546] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:55 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1466 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:56.836674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:56.837369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:56.844249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:56.844696 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:56.845461 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:56.845896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:56.907809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:56.915028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-38a03eb5-0149-4417-be4e-c2e9f5fe7000 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 200 len: 1466 microversion: 2.1 time: 0.082477 Dec 15 14:16:56.915596 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 275/547] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:56 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 1466 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:57.629729 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42b787fb-6e5f-4fe3-a432-4d7080703c06"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:57.630888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:57.637350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.638616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.639392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.639825 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.932523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:57.933181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: f8f88386-a08e-43b7-9832-f7932c369cd9] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:57.940358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.940750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.941560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.941993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.956702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] HTTP exception thrown: Instance f8f88386-a08e-43b7-9832-f7932c369cd9 could not be found. Dec 15 14:16:57.957322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Returning 404 to user: Instance f8f88386-a08e-43b7-9832-f7932c369cd9 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:16:57.958129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-08c99209-fb34-4afc-a8d9-a3209c012f0d tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9" status: 404 len: 111 microversion: 2.1 time: 0.029350 Dec 15 14:16:57.958939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 276/548] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:57 2021] GET /compute/v2.1/servers/f8f88386-a08e-43b7-9832-f7932c369cd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:16:57.966636 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:57.967125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:57.972743 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.974560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:57.974560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:57.974560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.000685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:16:58.330094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a3001fc3-b6d7-4859-ae73-dbcfee24a0b5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 204 len: 0 microversion: 2.1 time: 0.367094 Dec 15 14:16:58.330686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 277/549] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:16:57 2021] DELETE /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 14:16:58.335799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1455507136", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "64950cd0-9dda-4cbf-8aa1-d2615e4306bd"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:16:58.388981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] validate_networks() for [('64950cd0-9dda-4cbf-8aa1-d2615e4306bd', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:16:58.395790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3a58c9c8-a3f9-4f38-bded-e1348ab65982 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769533 Dec 15 14:16:58.399266 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 273/550] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:16:57 2021] POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:16:58.402556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:58.404475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:58.411112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.411607 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.412502 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.413098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.631873 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:58.639468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-63cf61df-2693-4e04-84cd-41692c5d802f tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.241899 Dec 15 14:16:58.640249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 274/551] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:58 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:58.803709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:16:58.804194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:16:58.804678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:16:58.805065 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:16:58.805472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:16:58.814557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.814996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.815795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:58.816259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:58.832363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Getting quotas for project f9d3f092c855418592b191699ec2f37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:16:58.836409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Getting quotas for user 6619a505b22b41a1974d6b5934846741 and project f9d3f092c855418592b191699ec2f37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:16:58.846955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:16:58.849379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:16:58.971174 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-69c0ae92-56a9-4e5f-b89d-2ea9490e7b67 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639112 Dec 15 14:16:58.971870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 278/552] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:16:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:16:58.982604 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bcfd58ea-4af5-4ad7-a781-24b89e75b921 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:58.983218 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bcfd58ea-4af5-4ad7-a781-24b89e75b921 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:59.039126 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bcfd58ea-4af5-4ad7-a781-24b89e75b921 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:59.046593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bcfd58ea-4af5-4ad7-a781-24b89e75b921 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1219 microversion: 2.1 time: 0.068482 Dec 15 14:16:59.047293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 275/553] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:58 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:16:59.656993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:16:59.657650 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:16:59.663540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.664012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.664778 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:16:59.665205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:16:59.797370 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:16:59.806466 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a30ef929-60e0-48a9-880f-452e7e317339 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.153304 Dec 15 14:16:59.807030 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 279/554] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:16:59 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:00.063221 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:00.063826 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:00.070638 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.071080 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.071845 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.072305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.136040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:00.144129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7441c01a-4221-4413-be97-46e8b1d48936 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1223 microversion: 2.1 time: 0.084652 Dec 15 14:17:00.144695 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 276/555] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:00 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:00.824332 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:00.824893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:00.831609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.832081 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:00.832845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:00.835191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:01.021412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:01.029057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc3e0c60-0e85-4dbf-95fb-e96a0d3fc91b tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.208512 Dec 15 14:17:01.030484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 280/556] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:00 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:01.162029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:01.163287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:01.170149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:01.170904 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:01.171981 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:01.172601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:01.380141 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:01.387373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-cf4cc027-100f-4c85-9972-a36fe712d2d5 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1289 microversion: 2.1 time: 0.229172 Dec 15 14:17:01.388001 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 277/557] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:01 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1289 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:02.047424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:02.048139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:02.054381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.058117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.058117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.058117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.290386 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:02.298345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-609d8c9c-f3a4-4259-baa7-b45e240018da tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.255489 Dec 15 14:17:02.298918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 281/558] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:02 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:02.405023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:02.405798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:02.412239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.412687 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.413467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.413900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.588549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:02.596889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5db8252c-2b50-4a4e-98e0-39713935b407 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.196300 Dec 15 14:17:02.597569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 278/559] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:02 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:02.845854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-862dfdb4-afbb-40e8-9730-e45241cc7ea1 req-056032f2-a9ec-48bf-8a71-0795fe39a039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b01b6c5-cbd9-4896-aa19-f740a8fcce46", "tag": "af89c1d9-b2e7-4b10-aba0-059ac4a7d85d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:02.847490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:02.847490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:02.854616 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-862dfdb4-afbb-40e8-9730-e45241cc7ea1 req-056032f2-a9ec-48bf-8a71-0795fe39a039 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:02.855059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-862dfdb4-afbb-40e8-9730-e45241cc7ea1 req-056032f2-a9ec-48bf-8a71-0795fe39a039 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:02.867122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-862dfdb4-afbb-40e8-9730-e45241cc7ea1 req-056032f2-a9ec-48bf-8a71-0795fe39a039 service nova] Creating event network-changed:af89c1d9-b2e7-4b10-aba0-059ac4a7d85d for instance 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 on hv-cinder-81322 Dec 15 14:17:02.871770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-862dfdb4-afbb-40e8-9730-e45241cc7ea1 req-056032f2-a9ec-48bf-8a71-0795fe39a039 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030255 Dec 15 14:17:02.872387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 282/560] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:03.315273 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:03.315796 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:03.322183 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.322625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.323424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.323864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.537761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:03.545584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-19c4d892-ee66-48b6-92fb-01870f68e8c5 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.234148 Dec 15 14:17:03.546226 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 279/561] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:03 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:03.615177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:03.615793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:03.621641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.622079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.623828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:03.623992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:03.764752 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:03.771902 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2fde6f85-8f03-44fb-9662-35ba5554fc50 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.161352 Dec 15 14:17:03.772481 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 283/562] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:03 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:04.562357 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:04.562955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:04.569253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.569707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.570487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.570923 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.788878 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:04.789490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:04.793434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:04.795658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.796185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.797490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:04.797929 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:04.801256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4484d7bc-e25c-4564-923c-3ae9d5b44a07 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1521 microversion: 2.1 time: 0.242588 Dec 15 14:17:04.802110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 280/563] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:04 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:05.050099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:05.057532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-71b6d005-280d-4f5f-94d9-5fa7f0193c6c tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.272339 Dec 15 14:17:05.063510 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 284/564] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:04 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:05.277122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-0d595762-de7f-4253-87c4-fe82a9bdfce8 req-a5001398-cd15-4440-976b-60c3f291c82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055c3fd-c364-425b-a659-292f94e6f09c", "name": "network-vif-deleted", "tag": "f550a9d9-c3b2-49c2-8bfc-1d263e506ae0"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:05.278714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:05.278714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:05.286511 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-0d595762-de7f-4253-87c4-fe82a9bdfce8 req-a5001398-cd15-4440-976b-60c3f291c82e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.286953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-0d595762-de7f-4253-87c4-fe82a9bdfce8 req-a5001398-cd15-4440-976b-60c3f291c82e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.297816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-0d595762-de7f-4253-87c4-fe82a9bdfce8 req-a5001398-cd15-4440-976b-60c3f291c82e service nova] Creating event network-vif-deleted:f550a9d9-c3b2-49c2-8bfc-1d263e506ae0 for instance 0055c3fd-c364-425b-a659-292f94e6f09c on hv-cinder-81322 Dec 15 14:17:05.302973 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-0d595762-de7f-4253-87c4-fe82a9bdfce8 req-a5001398-cd15-4440-976b-60c3f291c82e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029419 Dec 15 14:17:05.303556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 281/565] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:05.817690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:05.818319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:05.824846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.825515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.826450 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.827105 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.859579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.860131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.860582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lazy-loading 'fault' on Instance uuid 0055c3fd-c364-425b-a659-292f94e6f09c {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:17:05.900769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0118e016021f4e3eb4f0d0e59fe54488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685aa5d5bc754913a5ca3dd5518e129e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:05.908552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-321d3fdd-3149-4d65-8f15-33090d930dcb tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 200 len: 1311 microversion: 2.1 time: 0.094707 Dec 15 14:17:05.909119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 285/566] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:05 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:05.939225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:05.939934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:05.946238 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.946681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:05.947448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:05.947875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.075978 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:06.076753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:06.081100 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:06.083569 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.084058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.084853 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.085290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.089250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-698b1c8e-1708-4b45-a101-f2bcc546c319 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1592 microversion: 2.1 time: 0.154281 Dec 15 14:17:06.090444 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 282/567] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:05 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:06.237946 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:06.245671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4bc407a4-f54f-42ec-86a8-2dcb70a13600 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.173698 Dec 15 14:17:06.255214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 286/568] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:06 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:06.926146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:06.927133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] [instance: 0055c3fd-c364-425b-a659-292f94e6f09c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:06.933208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.933806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.934675 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:06.935182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:06.949655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] HTTP exception thrown: Instance 0055c3fd-c364-425b-a659-292f94e6f09c could not be found. Dec 15 14:17:06.950325 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] Returning 404 to user: Instance 0055c3fd-c364-425b-a659-292f94e6f09c could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:17:06.951175 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-008307cb-5410-4722-b0cc-4f68b085e175 tempest-ServerRescueNegativeTestJSON-552749463 tempest-ServerRescueNegativeTestJSON-552749463-project] 10.222.0.36 "GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c" status: 404 len: 111 microversion: 2.1 time: 0.028815 Dec 15 14:17:06.951716 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 283/569] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:06 2021] GET /compute/v2.1/servers/0055c3fd-c364-425b-a659-292f94e6f09c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:17:07.262837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:07.263751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:07.270311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:07.270787 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:07.271829 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:07.272297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:07.513609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:07.526546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5017131b-5fd2-4172-a8d7-aa8837919437 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.266797 Dec 15 14:17:07.527872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 287/570] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:07 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:08.550537 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:08.553021 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:08.553693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-18ad5b31-b0e5-443f-8825-86138cb98b4c req-1d568e22-397a-4a43-9042-fbb9f217cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:08.555944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:08.555944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:08.568752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:08.571278 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-18ad5b31-b0e5-443f-8825-86138cb98b4c req-1d568e22-397a-4a43-9042-fbb9f217cbb4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:08.571801 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.572969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:08.573615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.577028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-18ad5b31-b0e5-443f-8825-86138cb98b4c req-1d568e22-397a-4a43-9042-fbb9f217cbb4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:08.596477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-18ad5b31-b0e5-443f-8825-86138cb98b4c req-1d568e22-397a-4a43-9042-fbb9f217cbb4 service nova] Creating event network-changed:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:17:08.608047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-18ad5b31-b0e5-443f-8825-86138cb98b4c req-1d568e22-397a-4a43-9042-fbb9f217cbb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063025 Dec 15 14:17:08.609891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 288/571] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:08.810578 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:08.819524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-91ae6185-1859-4772-87d6-103d76ae22c4 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.279199 Dec 15 14:17:08.827704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 284/572] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:08 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:09.704621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-0e0255a1-4aeb-41da-b7d6-e94b9d553eb7 req-942c30db-abba-4a68-8774-2aea1be1e99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b01b6c5-cbd9-4896-aa19-f740a8fcce46", "name": "network-vif-plugged", "status": "completed", "tag": "af89c1d9-b2e7-4b10-aba0-059ac4a7d85d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:09.707181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:09.707181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:09.722859 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-0e0255a1-4aeb-41da-b7d6-e94b9d553eb7 req-942c30db-abba-4a68-8774-2aea1be1e99a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.723304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-0e0255a1-4aeb-41da-b7d6-e94b9d553eb7 req-942c30db-abba-4a68-8774-2aea1be1e99a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.753781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-0e0255a1-4aeb-41da-b7d6-e94b9d553eb7 req-942c30db-abba-4a68-8774-2aea1be1e99a service nova] Creating event network-vif-plugged:af89c1d9-b2e7-4b10-aba0-059ac4a7d85d for instance 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 on hv-cinder-81322 Dec 15 14:17:09.758715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-0e0255a1-4aeb-41da-b7d6-e94b9d553eb7 req-942c30db-abba-4a68-8774-2aea1be1e99a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061990 Dec 15 14:17:09.759488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 289/573] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:09.839256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:09.839868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:09.846805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.847259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:09.848076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:09.848513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.017836 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:10.025303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-be16f5bd-ba19-4a40-87f1-edafbc63e8fa tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.189676 Dec 15 14:17:10.025878 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 285/574] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:09 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:10.051153 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:10.051755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:10.061188 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.062389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.063180 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.063609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.102653 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4c12eaef-3295-42aa-a051-cacbe162443e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments/6a277577-3394-47a7-bfff-fe8be6349fe6" status: 200 len: 194 microversion: 2.20 time: 0.055394 Dec 15 14:17:10.104741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 290/575] 10.222.0.36 () {60 vars in 1453 bytes} [Wed Dec 15 14:17:10 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments/6a277577-3394-47a7-bfff-fe8be6349fe6 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:10.187390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:10.187898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:10.195039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.195546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.196374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.197820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.280935 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lazy-loading 'services' on Instance uuid 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:17:10.540330 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-131d71cb-e0df-452f-8de1-aa35e6cfd7dc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments/6a277577-3394-47a7-bfff-fe8be6349fe6" status: 202 len: 0 microversion: 2.20 time: 0.357259 Dec 15 14:17:10.550434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:10.555430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:10.559220 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 286/576] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Dec 15 14:17:10 2021] DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments/6a277577-3394-47a7-bfff-fe8be6349fe6 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:17:10.564546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.566046 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.567494 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:10.568632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:10.601909 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a30988d9-f97f-471d-9d61-92ed21ff505c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055669 Dec 15 14:17:10.603079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 291/577] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 14:17:10 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:11.043522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:11.044251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:11.051358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.052053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.052921 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.053556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.193990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:11.201241 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-64aed726-1822-48e3-af1c-602439cbb484 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1319 microversion: 2.1 time: 0.162907 Dec 15 14:17:11.201828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 287/578] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:11 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:11.614516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:11.615421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:11.621455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.621894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.622670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.623095 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.653597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4c6984a7-c125-4c60-8b17-e6a80b6acfe3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042928 Dec 15 14:17:11.654381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 292/579] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 14:17:11 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:11.668891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-369072057"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:11.669657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:11.676224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.676667 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.677440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:11.677867 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:11.832745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.network.security_group_api [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Adding security group e3a6788a-4487-4c74-bd81-0bd2c008548d to port 7f77f8ec-a564-45e4-a011-24904a851e4c Dec 15 14:17:12.218744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:12.218744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.224564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.225013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.225797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.226227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.340250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-430e4df5-fbff-4eca-a6b5-c56c6016b396 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action" status: 202 len: 0 microversion: 2.1 time: 0.675010 Dec 15 14:17:12.344565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 288/580] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:11 2021] POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:12.349375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:12.350225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.362194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.368183 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.369247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.369837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.529739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:12.548658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-090cf1b1-73d0-477c-afb3-656d57e971b3 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1508 microversion: 2.1 time: 0.330079 Dec 15 14:17:12.548658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 293/581] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:12 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:12.554425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-db31a18e-37fa-484f-9c86-4c00a156bef0 req-15c6b03d-a73f-4fc0-a2da-b6018d0d6cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:12.556289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:12.556289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:12.564269 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-db31a18e-37fa-484f-9c86-4c00a156bef0 req-15c6b03d-a73f-4fc0-a2da-b6018d0d6cb8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.565228 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-db31a18e-37fa-484f-9c86-4c00a156bef0 req-15c6b03d-a73f-4fc0-a2da-b6018d0d6cb8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.582146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-db31a18e-37fa-484f-9c86-4c00a156bef0 req-15c6b03d-a73f-4fc0-a2da-b6018d0d6cb8 service nova] Creating event network-changed:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:17:12.591782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-db31a18e-37fa-484f-9c86-4c00a156bef0 req-15c6b03d-a73f-4fc0-a2da-b6018d0d6cb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042716 Dec 15 14:17:12.592951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 294/582] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:12.618941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:12.619630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.645290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.646710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.647752 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.649458 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.702648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:12.722144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7029193c-db2d-4366-9280-4ef9f11b5283 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1757 microversion: 2.1 time: 0.376369 Dec 15 14:17:12.722742 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 289/583] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:12 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1757 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:12.738364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b11927a-6560-4787-a9e4-0c75cf140d38", "device": "/dev/sdb"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:12.739918 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:12.763490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.766041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.767323 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:12.767704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:12.770831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lazy-loading 'services' on Instance uuid ef62bed0-b1e8-4769-878e-4dc0bbb2c15f {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:17:13.026292 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a5a5caa0-8fbc-4fe8-844a-c290745d15d2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments/1d493ca0-9573-4cde-897d-22b3666f370b" status: 202 len: 0 microversion: 2.1 time: 0.429507 Dec 15 14:17:13.027416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 295/584] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:17:12 2021] DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments/1d493ca0-9573-4cde-897d-22b3666f370b => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:13.037488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:13.044364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:13.057723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.058764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.060825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.063088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.111880 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d96ed1a0-663c-4d2b-9685-50766cefd47f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080791 Dec 15 14:17:13.121500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 296/585] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 14:17:13 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:13.195486 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:13.196024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:13.203710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.204631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.205550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.205854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.261794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:17:13.549781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc834a49-4d74-4a12-abb7-845fe796df97 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 204 len: 0 microversion: 2.20 time: 0.357828 Dec 15 14:17:13.550324 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 297/586] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 14:17:13 2021] DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:17:13.558578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:13.559325 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:13.565771 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.566221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.567069 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:13.567502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:13.640617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fa1edc77-26f1-48a6-a535-3db0f1459c25 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "POST /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909571 Dec 15 14:17:13.648467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 290/587] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:17:12 2021] POST /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:13.721637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:13.729731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:13.731271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:13.732446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e1fa5f6b-f635-4aff-bafe-eaaf888993af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.177815 Dec 15 14:17:13.733046 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 298/588] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:13 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:14.199550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-81f01f92-378b-4f74-87f2-f0c887196ec6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:14.207473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81f01f92-378b-4f74-87f2-f0c887196ec6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.207845 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-81f01f92-378b-4f74-87f2-f0c887196ec6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.230571 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-81f01f92-378b-4f74-87f2-f0c887196ec6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Going to try to stop instance {{(pid=116681) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 14:17:14.429611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-81f01f92-378b-4f74-87f2-f0c887196ec6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 202 len: 0 microversion: 2.1 time: 0.233937 Dec 15 14:17:14.439880 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 291/589] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:14 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:14.440093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:14.440093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:14.445828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.446491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.447282 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.447711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.582512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:14.589813 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-15af6d04-e4da-438f-94f3-95fa45397176 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.155269 Dec 15 14:17:14.590674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 299/590] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:14 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:14.755561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:14.756406 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:14.762769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.763316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.764476 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:14.765104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:14.890035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-499467747", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "0ca1363a-730e-4e8b-a82f-8b7d81e5a05c"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:14.896838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:14.904524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:14.906619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:14.907779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0048500d-a699-477e-9fdb-5bd8133365c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.160950 Dec 15 14:17:14.908479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 292/591] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:14 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:14.941411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] validate_networks() for [('0ca1363a-730e-4e8b-a82f-8b7d81e5a05c', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:17:15.283142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:17:15.283596 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:17:15.284136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:17:15.284541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:17:15.284949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:17:15.293589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.294035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.294842 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.295275 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.311209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:17:15.315022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for user 85e8dd95f1734cf496ebf2addbe7cb4c and project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:17:15.325551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:17:15.328353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:17:15.446044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-45c8581d-1936-4e36-93f6-69d9c81bedb8 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688867 Dec 15 14:17:15.447218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 300/592] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:17:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:17:15.457918 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-abe658f7-035a-4a25-977d-7769bfdea97a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:15.458898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-abe658f7-035a-4a25-977d-7769bfdea97a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.515749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-abe658f7-035a-4a25-977d-7769bfdea97a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:15.523024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-abe658f7-035a-4a25-977d-7769bfdea97a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1217 microversion: 2.1 time: 0.068678 Dec 15 14:17:15.523689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 293/593] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:15 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:15.607142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:15.608379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.613900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.614339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.615116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.615849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.922986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:15.925850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:15.936964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:15.936964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.936964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.936964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:15.947378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-de2bf513-858e-44c3-a6e7-9802372ad92e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.330337 Dec 15 14:17:15.948081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:15.948191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 301/594] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:15 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:16.166468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:16.166468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:16.166750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:16.167524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-880f28b1-7904-44dd-9374-48cd0d5da0ce tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1722 microversion: 2.20 time: 0.245617 Dec 15 14:17:16.168099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 294/595] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:15 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:16.540854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:16.541770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:16.549385 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:16.549825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:16.550639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:16.551065 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:16.799097 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:16.810083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5377f1c8-4579-4038-bdfd-bdb5a450fcd8 req-ba5f281e-0e85-4822-ba80-d24fe3adc381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8631f02e-761c-4b6a-9b55-fd29ddfe47d8", "name": "network-vif-deleted", "tag": "844a6495-532e-422c-8e4b-f5c0486fc42a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:16.812662 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:16.812662 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:16.822331 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5377f1c8-4579-4038-bdfd-bdb5a450fcd8 req-ba5f281e-0e85-4822-ba80-d24fe3adc381 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:16.823027 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5377f1c8-4579-4038-bdfd-bdb5a450fcd8 req-ba5f281e-0e85-4822-ba80-d24fe3adc381 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:16.832562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2fa20d1e-5e80-4dcf-9ac1-46355fffa80e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1221 microversion: 2.1 time: 0.295251 Dec 15 14:17:16.834903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 302/596] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:16 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:16.841766 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5377f1c8-4579-4038-bdfd-bdb5a450fcd8 req-ba5f281e-0e85-4822-ba80-d24fe3adc381 service nova] Creating event network-vif-deleted:844a6495-532e-422c-8e4b-f5c0486fc42a for instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 on hv-cinder-81322 Dec 15 14:17:16.852819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5377f1c8-4579-4038-bdfd-bdb5a450fcd8 req-ba5f281e-0e85-4822-ba80-d24fe3adc381 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045609 Dec 15 14:17:16.853479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 295/597] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:16.955635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:16.956267 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:16.963741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:16.971113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:16.971113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:16.971113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:17.128057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:17.135407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-91b72455-937f-4a0d-a387-4e53817d967d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.184767 Dec 15 14:17:17.135985 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 303/598] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:16 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:17.189648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:17.190341 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:17.201336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:17.201336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:17.201336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:17.201336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:17.270162 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:17.280337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:17.282180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:17.283432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c9d3a771-5bce-4afb-a64e-425a89dfef18 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 200 len: 1366 microversion: 2.20 time: 0.099450 Dec 15 14:17:17.284224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 296/599] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:17 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:17.851880 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:17.852882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:17.860777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:17.861294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:17.862140 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:17.862642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:17.963601 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:17.973192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ca432421-4b93-4d1d-8292-18d86c3a4503 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1277 microversion: 2.1 time: 0.125915 Dec 15 14:17:17.973889 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 304/600] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:17 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:18.152660 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:18.153649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:18.160767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:18.161404 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:18.162384 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:18.162814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:18.301395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:18.302369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:18.308550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:18.309100 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:18.309965 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:18.310490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:18.325033 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. Dec 15 14:17:18.325664 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:17:18.327495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0534e5b8-5c1b-493e-978f-7600c2a8c52b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 404 len: 111 microversion: 2.20 time: 0.029173 Dec 15 14:17:18.328336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 305/601] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:18 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:17:18.336885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b5c56c12-292f-4695-9002-a87cefde3661 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '.version_select at 0x7f9cbe8b7af0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:18.384669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:18.394555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3117330d-56a5-4dcd-a7a2-41306449a266 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.245909 Dec 15 14:17:18.395679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 297/602] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:18 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:18.431793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b5c56c12-292f-4695-9002-a87cefde3661 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319654944" status: 204 len: 0 microversion: 2.20 time: 0.094713 Dec 15 14:17:18.431793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 306/603] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Dec 15 14:17:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319654944 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 14:17:18.991528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:18.992598 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:18.999863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:19.000335 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:19.001413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:19.001884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:19.328718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:19.337018 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f6a8ec2f-65f4-4938-8eae-775e62aec066 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.349175 Dec 15 14:17:19.337912 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 298/604] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:18 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:19.413005 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:19.415110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:19.421525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:19.421964 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:19.422740 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:19.423166 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:19.661777 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: .version_select at 0x7f9cbe3303a0>, body: {"keypair": {"name": "tempest-keypair-1105277184"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:19.674534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:19.676721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:17:19.680659 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:17:19.682134 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2ded3894-7154-4d1f-b0f7-c4691f2973c9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.273971 Dec 15 14:17:19.682703 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 307/605] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:19 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:20.019603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:17:20.024085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:17:20.034016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-652487e1-d1d1-46a5-bd67-67f3bcf2bb1a req-44e66e2a-a676-4b9d-ac58-3bb252d7d865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6facd328-628c-4075-b7e0-685acaf6112d", "tag": "8d57ebc8-df52-4c7e-a667-d3e62ecd8753"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:20.035853 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:20.035853 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:20.042739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-652487e1-d1d1-46a5-bd67-67f3bcf2bb1a req-44e66e2a-a676-4b9d-ac58-3bb252d7d865 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:20.047359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-652487e1-d1d1-46a5-bd67-67f3bcf2bb1a req-44e66e2a-a676-4b9d-ac58-3bb252d7d865 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:20.050375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-53eff093-6c8a-490a-912c-6cbec8605b44 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.395052 Dec 15 14:17:20.056860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 299/606] 10.222.0.36 () {62 vars in 1198 bytes} [Wed Dec 15 14:17:19 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 14:17:20.057188 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-652487e1-d1d1-46a5-bd67-67f3bcf2bb1a req-44e66e2a-a676-4b9d-ac58-3bb252d7d865 service nova] Creating event network-changed:8d57ebc8-df52-4c7e-a667-d3e62ecd8753 for instance 6facd328-628c-4075-b7e0-685acaf6112d on hv-cinder-81322 Dec 15 14:17:20.059949 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-652487e1-d1d1-46a5-bd67-67f3bcf2bb1a req-44e66e2a-a676-4b9d-ac58-3bb252d7d865 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029641 Dec 15 14:17:20.060570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 308/607] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:20.354768 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:20.355371 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:20.362875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:20.363320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:20.364130 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:20.364569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:20.608689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:20.622020 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ea83775d-73be-4188-8c1e-2afc80224e60 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.265503 Dec 15 14:17:20.634319 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 300/608] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:20 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:20.699356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:20.700075 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:20.706127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:20.706571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:20.707330 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:20.707754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:20.940803 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:20.949379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bf0df995-2ae3-4f1a-8be3-827cf04e8dc8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.254578 Dec 15 14:17:20.950561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 309/609] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:20 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:21.641438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:21.643553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:21.648987 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:21.649429 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:21.650286 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:21.650798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:21.870306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:21.878258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-09b369f6-10a6-41cc-8074-2884031b1185 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.241551 Dec 15 14:17:21.878769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 301/610] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:21 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:21.966390 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:21.966994 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:21.973557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:21.974000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:21.974760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:21.975188 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:22.218845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:22.226247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1f430ba5-a0f9-4800-8c4a-997b5a695632 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.263556 Dec 15 14:17:22.227158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 310/611] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:21 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:22.787275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-733439000", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87207a00-487c-41ca-9a1a-60e78eea9937"}], "security_groups": [{"name": "tempest-securitygroup--1724185551"}], "key_name": "tempest-keypair-1105277184", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:22.885680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] validate_networks() for [('87207a00-487c-41ca-9a1a-60e78eea9937', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:17:22.894901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:22.895517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:22.901532 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:22.901975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:22.902747 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:22.903176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:23.092934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:23.100642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-078fdb1e-7d3d-47bd-8e45-85464b639247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.209339 Dec 15 14:17:23.101220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 311/612] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:22 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:23.244363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:23.245777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:23.252354 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:23.252806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:23.253589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:23.254025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:23.580775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:17:23.580775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:17:23.580775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:17:23.580775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:17:23.580775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:17:23.588066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:23.588589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:23.589458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:23.590117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:23.611372 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:17:23.615594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Getting quotas for user 6a320b1bc4704b91b202e253cd428373 and project 0d09ce10de40483aa9ac94558a84aa47. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:17:23.629074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:17:23.631389 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:17:23.643763 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:23.651280 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0a322037-cd46-4c2b-bad3-97c3ab66a3ba tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.410585 Dec 15 14:17:23.651981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 312/613] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:23 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:23.801238 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1917a15a-297c-4bfd-830e-ec30a1689305 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.018004 Dec 15 14:17:23.806836 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 302/614] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Dec 15 14:17:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 14:17:23.820975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:23.821194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:23.873898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:23.883003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:23.884776 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:23.886296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-111cfa9d-6063-4a5c-8b8d-bdafafeaf870 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1281 microversion: 2.20 time: 0.078043 Dec 15 14:17:23.894458 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 313/615] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:23 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:24.118339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:24.118958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:24.126366 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.126828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.127618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.128087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.269842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:24.277407 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c3935101-dab2-4d69-977b-1244fa4fdc2e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.163022 Dec 15 14:17:24.277974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 303/616] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:24 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:24.668586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:24.669289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:24.676076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.676518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.677277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.677704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.815082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:24.822462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3ecf2c90-83cc-4d43-9a33-ba29e9422fcd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1675 microversion: 2.1 time: 0.157657 Dec 15 14:17:24.823027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 314/617] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:24 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:24.905179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:24.905739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:24.912271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.912726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.913503 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:24.913939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:24.974552 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:24.983364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:24.985051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:24.986166 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2561b951-c55c-4bea-8802-f96923a95a34 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1285 microversion: 2.20 time: 0.084877 Dec 15 14:17:24.986727 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 304/618] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:24 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:25.294047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:25.294683 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:25.301200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:25.301646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:25.302442 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:25.302872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:25.433223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:25.441334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-091c8e7e-5196-47f3-9f87-714ed0d88723 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.151067 Dec 15 14:17:25.441898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 315/619] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:25 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:25.839478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:25.840135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:25.846290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:25.846739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:25.847512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:25.847968 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.004552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:26.005402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:26.011901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.012459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.013379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.013994 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.103074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.116882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.118434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.120117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-81f7efec-9610-40c4-898e-268254ed97b8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1341 microversion: 2.20 time: 0.118967 Dec 15 14:17:26.120224 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.121035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 316/620] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:25 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1341 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:26.127950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ea922bfb-2f4e-4fa6-b26c-4c372f339a28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1652 microversion: 2.1 time: 0.292117 Dec 15 14:17:26.128715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 305/621] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:25 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1652 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:26.145802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d8013b33-db5c-4a14-8c37-f8700cec4e7d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:26.151699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8013b33-db5c-4a14-8c37-f8700cec4e7d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.152176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d8013b33-db5c-4a14-8c37-f8700cec4e7d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.217435 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d8013b33-db5c-4a14-8c37-f8700cec4e7d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Going to try to start instance {{(pid=116680) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 14:17:26.407712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d8013b33-db5c-4a14-8c37-f8700cec4e7d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action" status: 202 len: 0 microversion: 2.1 time: 0.266351 Dec 15 14:17:26.408635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 317/622] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:26 2021] POST /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:26.416586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:26.418146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:26.423283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.423733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.424564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.424995 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.459095 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:26.459903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:26.465818 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.466265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.467751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:26.468211 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:26.722107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.729653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4799972a-8ce3-486a-a146-a60c5bbbf1e2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1661 microversion: 2.1 time: 0.316778 Dec 15 14:17:26.730306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 306/623] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:26 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1661 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:26.759103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:26.767419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-151ca02e-0630-44ce-abaa-f37ad4dc9579 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.312272 Dec 15 14:17:26.768019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 318/624] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:26 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:27.136869 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:27.137472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:27.144877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.145326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.146156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.146578 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.275185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:27.282884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:27.284433 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:27.285549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e1989bb0-6d41-48aa-bcbe-6e28d7d65005 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.152561 Dec 15 14:17:27.286106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 307/625] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:27 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:27.746898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:27.747513 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:27.753956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.754406 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.755178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.755636 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.784859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:27.785567 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:27.791475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.791937 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.792723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:27.793159 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:27.939380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:27.946615 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-685f3573-d232-4cde-8c23-7c582c7ebc77 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1661 microversion: 2.1 time: 0.203410 Dec 15 14:17:27.947187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 319/626] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:27 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1661 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:27.968593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:27.975817 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dea2add8-f7f9-42ce-8a1f-109699936869 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.194641 Dec 15 14:17:27.976413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 308/627] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:27 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:28.304192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:28.304719 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:28.311119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:28.311699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:28.312338 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:28.312769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:28.441178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:28.448843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:28.450384 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:28.452776 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d1a79204-f0e1-4f10-800b-66d3a51cd746 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.151047 Dec 15 14:17:28.453459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 320/628] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:28 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:28.964416 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:28.965029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:28.971824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:28.972374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:28.973152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:28.973587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:28.992745 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:28.993348 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:28.999561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:29.000051 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:29.000827 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:29.001256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:29.173908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:29.177975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:29.181256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a33710bf-90c5-4949-9c97-5568d0a98be7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1661 microversion: 2.1 time: 0.220549 Dec 15 14:17:29.181830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 309/629] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:28 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1661 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:29.185136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5e91bd01-bf06-4c5c-816c-1484dd06c247 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.196000 Dec 15 14:17:29.185857 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 321/630] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:28 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:29.427589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-a68755fd-63a3-488a-b29e-1565c08fb537 req-c0c851d4-a77e-4c36-8208-36565cdee4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6facd328-628c-4075-b7e0-685acaf6112d", "name": "network-vif-plugged", "status": "completed", "tag": "8d57ebc8-df52-4c7e-a667-d3e62ecd8753"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:29.429393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:29.429393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:29.436776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-a68755fd-63a3-488a-b29e-1565c08fb537 req-c0c851d4-a77e-4c36-8208-36565cdee4d9 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:29.438743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-a68755fd-63a3-488a-b29e-1565c08fb537 req-c0c851d4-a77e-4c36-8208-36565cdee4d9 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:29.449676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-a68755fd-63a3-488a-b29e-1565c08fb537 req-c0c851d4-a77e-4c36-8208-36565cdee4d9 service nova] Creating event network-vif-plugged:8d57ebc8-df52-4c7e-a667-d3e62ecd8753 for instance 6facd328-628c-4075-b7e0-685acaf6112d on hv-cinder-81322 Dec 15 14:17:29.455281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-a68755fd-63a3-488a-b29e-1565c08fb537 req-c0c851d4-a77e-4c36-8208-36565cdee4d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Dec 15 14:17:29.455897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 310/631] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:29.473088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:29.474218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:29.481791 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:29.482917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:29.483965 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:29.484583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:29.798947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:29.807861 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:29.809512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:29.811176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-61dc7e92-7087-41ca-8fa0-0891eaa4a0f6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.342290 Dec 15 14:17:29.822668 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 322/632] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:29 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:30.199539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:30.200270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:30.202705 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:30.203835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:30.208226 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.208672 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.209761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.210358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.210966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.211622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.212634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.213365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.542687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:30.548959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:30.552037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-54faff86-0440-4adc-9bc0-0fff1630478e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1317 microversion: 2.1 time: 0.353638 Dec 15 14:17:30.552885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 323/633] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:30 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:30.558204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-5c3ea109-a283-46de-b091-5e0098c7bbec req-6f36fbfc-985d-472f-9bff-958b6393964e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:30.563718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:30.563718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:30.568472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-5c3ea109-a283-46de-b091-5e0098c7bbec req-6f36fbfc-985d-472f-9bff-958b6393964e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.569041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4838dfee-2770-4b19-b2fb-c5ac460931b9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1661 microversion: 2.1 time: 0.373452 Dec 15 14:17:30.569642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 311/634] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:30 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1661 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:30.569787 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-5c3ea109-a283-46de-b091-5e0098c7bbec req-6f36fbfc-985d-472f-9bff-958b6393964e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.582819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-5c3ea109-a283-46de-b091-5e0098c7bbec req-6f36fbfc-985d-472f-9bff-958b6393964e service nova] Creating event network-changed:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:17:30.588263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-5c3ea109-a283-46de-b091-5e0098c7bbec req-6f36fbfc-985d-472f-9bff-958b6393964e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033914 Dec 15 14:17:30.588887 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 324/635] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:30.829723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:30.830539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:30.837564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.838092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:30.839058 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:30.839497 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:31.008239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:31.016092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:31.017641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:31.018735 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9366c21a-cf66-46f5-8f53-0eddacdc0c54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.192939 Dec 15 14:17:31.019298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 312/636] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:30 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:31.571112 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:31.571895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:31.578132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:31.578604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:31.579368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:31.579794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:31.586602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:31.587875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:31.594620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:31.597717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:31.597717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:31.597717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:31.786296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:31.789581 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:31.793805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f46e26fc-f67d-4fc9-a386-2f491e634616 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1506 microversion: 2.1 time: 0.227417 Dec 15 14:17:31.794390 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 325/637] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:31 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:31.797248 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0aefee2c-a3aa-46a5-b12d-088b75bb3de6 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1665 microversion: 2.1 time: 0.214673 Dec 15 14:17:31.797805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 313/638] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:31 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1665 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:32.036817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:32.037341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:32.043026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:32.043459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:32.044249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:32.044681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:32.173891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:32.181580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:32.183122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:32.184237 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c13c443d-73d2-4336-bcc9-da0dbd8929f1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.151261 Dec 15 14:17:32.184798 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 326/639] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:32 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:33.202401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:33.203009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:33.209415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.209891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.210660 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.211096 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.347761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:33.355841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:33.357933 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:33.359153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e992fe0f-af15-4810-a130-8b436422fa3c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.160846 Dec 15 14:17:33.359717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 314/640] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:33 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:33.502046 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bb6d27e-e075-4414-bf02-901ce6ba1996"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:33.503079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:33.509331 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.509765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.510529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.510954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.677806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:33.678341 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:33.684120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.684590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.685354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:33.686307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:33.765597 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lazy-loading 'services' on Instance uuid 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:17:34.037161 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-192cedba-9497-4e3a-9cbe-9463db44a18f tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46/os-volume_attachments/2b11927a-6560-4787-a9e4-0c75cf140d38" status: 202 len: 0 microversion: 2.1 time: 0.362769 Dec 15 14:17:34.037690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 315/641] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:17:33 2021] DELETE /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46/os-volume_attachments/2b11927a-6560-4787-a9e4-0c75cf140d38 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:17:34.313898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e3ccdcd7-1163-4911-93d8-a542f95a0751 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815499 Dec 15 14:17:34.314457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 327/642] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:17:33 2021] POST /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:34.378690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:34.379461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:34.385478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:34.385927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:34.386734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:34.387164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:34.523225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:34.531462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:34.533062 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:34.534148 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-791099a9-6eaa-4bc7-bbea-0d866b9b61a2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.160297 Dec 15 14:17:34.534711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 316/643] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:34 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:35.144585 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:35.145171 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:35.151187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.151659 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.156181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.156181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.182474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:17:35.472236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2be000d6-ed58-4e9f-b47d-2e5384ec9535 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 204 len: 0 microversion: 2.1 time: 0.331898 Dec 15 14:17:35.472928 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 328/644] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:17:35 2021] DELETE /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:17:35.480978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:35.481589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:35.488458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.488904 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.489675 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.490106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.552993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:35.553779 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:35.561269 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.561821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.562674 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:35.563239 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:35.649466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:35.657527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-99222ed3-9d17-4e75-a471-bdae79dfd909 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1514 microversion: 2.1 time: 0.180135 Dec 15 14:17:35.658434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 317/645] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:35 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:35.716189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:35.724501 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:35.726050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:35.727412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c99b2247-3460-4bd0-aea6-b3cdf285bdbe tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.178747 Dec 15 14:17:35.728012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 329/646] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:35 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:36.509050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-6c960952-1094-43f7-97d2-3ab0ee98d1a7 req-4dab8968-ab13-479a-bd5c-f1542dec0ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "name": "network-vif-plugged", "status": "completed", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:36.510644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:36.510644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:36.518800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-6c960952-1094-43f7-97d2-3ab0ee98d1a7 req-4dab8968-ab13-479a-bd5c-f1542dec0ab4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:36.519259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-6c960952-1094-43f7-97d2-3ab0ee98d1a7 req-4dab8968-ab13-479a-bd5c-f1542dec0ab4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:36.529925 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-6c960952-1094-43f7-97d2-3ab0ee98d1a7 req-4dab8968-ab13-479a-bd5c-f1542dec0ab4 service nova] Creating event network-vif-plugged:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:17:36.534755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-6c960952-1094-43f7-97d2-3ab0ee98d1a7 req-4dab8968-ab13-479a-bd5c-f1542dec0ab4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029257 Dec 15 14:17:36.535349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 318/647] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:36.674357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:36.674990 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:36.681287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:36.681762 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:36.687001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:36.687001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:36.746391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:36.747237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:36.754440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:36.754957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:36.755821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:36.756349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:37.107431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:37.116270 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-039c4afd-e953-4f40-ae41-54f307e406e1 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1514 microversion: 2.1 time: 0.445444 Dec 15 14:17:37.116852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 330/648] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:36 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:37.210163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:37.217849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:37.219408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:37.220523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6718aadd-ebc0-4c6e-989c-bada52ef342f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.478495 Dec 15 14:17:37.221078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 319/649] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:36 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:38.010554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-62173cc8-e70f-430f-8cd4-5c5948955ad4 req-9a9f9a79-1cbf-451f-9e73-d82672cddb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b01b6c5-cbd9-4896-aa19-f740a8fcce46", "name": "network-vif-deleted", "tag": "af89c1d9-b2e7-4b10-aba0-059ac4a7d85d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:38.012190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:38.012190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:17:38.020359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-62173cc8-e70f-430f-8cd4-5c5948955ad4 req-9a9f9a79-1cbf-451f-9e73-d82672cddb23 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:38.022766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-62173cc8-e70f-430f-8cd4-5c5948955ad4 req-9a9f9a79-1cbf-451f-9e73-d82672cddb23 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:38.032505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-62173cc8-e70f-430f-8cd4-5c5948955ad4 req-9a9f9a79-1cbf-451f-9e73-d82672cddb23 service nova] Creating event network-vif-deleted:af89c1d9-b2e7-4b10-aba0-059ac4a7d85d for instance 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 on hv-cinder-81322 Dec 15 14:17:38.037712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-62173cc8-e70f-430f-8cd4-5c5948955ad4 req-9a9f9a79-1cbf-451f-9e73-d82672cddb23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Dec 15 14:17:38.038302 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 331/650] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:38.133436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:38.134097 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:38.140759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:38.141200 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:38.142023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:38.142454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:38.204153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6619a505b22b41a1974d6b5934846741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d3f092c855418592b191699ec2f37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:38.211449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-05a86a43-38e7-49ca-920e-54dfcc890614 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 200 len: 1304 microversion: 2.1 time: 0.081755 Dec 15 14:17:38.212028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 320/651] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:38 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 1304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:38.239397 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:38.240128 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:38.246110 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:38.246730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:38.247502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:38.250016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:38.378541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:38.386523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:38.388157 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:38.390355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2758c95d-a31e-4879-9a6d-af863e65ef85 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1407 microversion: 2.20 time: 0.154974 Dec 15 14:17:38.390920 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 332/652] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:38 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:39.229278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:39.229898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] [instance: 9b01b6c5-cbd9-4896-aa19-f740a8fcce46] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:39.236487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.236935 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.237723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.238165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.252875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] HTTP exception thrown: Instance 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 could not be found. Dec 15 14:17:39.253470 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] Returning 404 to user: Instance 9b01b6c5-cbd9-4896-aa19-f740a8fcce46 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:17:39.254475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-71bcb814-705b-4fd7-bbbf-7def4468c866 tempest-VolumesSnapshotTestJSON-773734004 tempest-VolumesSnapshotTestJSON-773734004-project] 10.222.0.36 "GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46" status: 404 len: 111 microversion: 2.1 time: 0.030151 Dec 15 14:17:39.255023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 321/653] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:39 2021] GET /compute/v2.1/servers/9b01b6c5-cbd9-4896-aa19-f740a8fcce46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:17:39.408389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:39.408996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:39.415189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.415651 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.416429 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.416868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.551881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:39.559681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:39.561353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:39.562547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-662dbe06-7cf7-400b-a227-9815b1ecea59 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1598 microversion: 2.20 time: 0.159019 Dec 15 14:17:39.563104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 333/654] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:17:39 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:17:39.580782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:39.581271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:39.587144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.587587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.588384 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:39.588812 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:39.668461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2f2014fa-676d-4f94-b46b-d7490a464ba3 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091401 Dec 15 14:17:39.669055 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 322/655] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Dec 15 14:17:39 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:17:40.659619 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:40.660591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:40.667440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:40.667978 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:40.668830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:40.669363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:40.672343 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-c1a0516c-40ca-4b3d-a980-8b34b762ba1b req-a200a614-1a08-43ce-b2da-509a2f2758b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:40.673879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:40.673879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:40.685350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-c1a0516c-40ca-4b3d-a980-8b34b762ba1b req-a200a614-1a08-43ce-b2da-509a2f2758b1 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:40.685793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-c1a0516c-40ca-4b3d-a980-8b34b762ba1b req-a200a614-1a08-43ce-b2da-509a2f2758b1 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:40.697222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-c1a0516c-40ca-4b3d-a980-8b34b762ba1b req-a200a614-1a08-43ce-b2da-509a2f2758b1 service nova] Creating event network-changed:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:17:40.701823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-c1a0516c-40ca-4b3d-a980-8b34b762ba1b req-a200a614-1a08-43ce-b2da-509a2f2758b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034035 Dec 15 14:17:40.702419 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 323/656] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:40.741890 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-89cca3d1-fceb-41a5-bc31-9c8aa3fa0d6a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.086077 Dec 15 14:17:40.742531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 334/657] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:40 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:41.755898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:41.756928 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:41.763384 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:41.763834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:41.764684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:41.765119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:42.926405 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:42.927423 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:42.934209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:42.934654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:42.935421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:42.935853 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:43.173778 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-69052839-9ad9-44a1-a37c-ce83ae3517ab tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action" status: 202 len: 0 microversion: 2.1 time: 0.251296 Dec 15 14:17:43.174413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 335/658] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:17:42 2021] POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:17:43.182611 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:43.183234 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:43.192937 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:43.193378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:43.194137 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:43.194563 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:43.352340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:43.360737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-22c89f24-bac3-42ed-abd8-911697285246 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1749 microversion: 2.1 time: 0.182072 Dec 15 14:17:43.361321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 336/659] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:43 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:43.927777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427316062", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "0ca1363a-730e-4e8b-a82f-8b7d81e5a05c"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:43.978178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] validate_networks() for [('0ca1363a-730e-4e8b-a82f-8b7d81e5a05c', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:17:44.334339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:17:44.334751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:17:44.335297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:17:44.335649 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:17:44.336076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:17:44.345010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:44.345446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:44.346243 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:44.346669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:44.363491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:17:44.367306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for user 85e8dd95f1734cf496ebf2addbe7cb4c and project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:17:44.378741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:17:44.381090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:17:44.494883 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-410220f4-4809-41a4-b667-d7aa3c109c68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 2.744018 Dec 15 14:17:44.495609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 324/660] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:41 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:44.501963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:44.502659 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:44.509253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:44.509703 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:44.510820 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:44.510932 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:44.524670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-26e4ec0a-b311-4007-a3f6-c3e79fe6605e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600599 Dec 15 14:17:44.526714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 337/661] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:17:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:17:44.550496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9f626c02-da44-4106-b132-b7e8798042f7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:44.551194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9f626c02-da44-4106-b132-b7e8798042f7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:44.637469 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9f626c02-da44-4106-b132-b7e8798042f7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:44.645345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9f626c02-da44-4106-b132-b7e8798042f7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1218 microversion: 2.1 time: 0.100098 Dec 15 14:17:44.652028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 338/662] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:44 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:44.785917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:44.794141 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-14535efc-3c11-42ff-9211-a927bbe895c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1749 microversion: 2.1 time: 0.297355 Dec 15 14:17:44.794728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 325/663] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:44 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1749 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:45.505402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:45.506393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:45.512681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.513128 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.514750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.515220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.581747 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4adeb7bf-ce28-4bad-ab31-508cd3c20259 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.079867 Dec 15 14:17:45.585127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 339/664] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:45 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:45.662566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:45.663172 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:45.670281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.677368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.677368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.677368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.734102 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:45.741346 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-04a63aac-4b83-46e5-a3f2-2ac472fcbd4a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1214 microversion: 2.1 time: 0.082678 Dec 15 14:17:45.741901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 326/665] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:45 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:45.812869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:45.813574 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:45.820470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.820946 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.821733 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:45.822169 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:45.978666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:45.985300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-01901957-3963-464b-95dd-b405c02aff9c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.177337 Dec 15 14:17:45.985860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 340/666] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:45 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:46.593701 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:46.594943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:46.602506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:46.603279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:46.604300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:46.604934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:46.673725 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-252ed8e3-4f07-481a-bfcd-f0390a9ca0fc tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.084389 Dec 15 14:17:46.674403 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 327/667] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:46 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:46.761416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:46.762117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:46.769436 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:46.769955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:46.770817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:46.771315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:46.840698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:46.848544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c289e8b3-4e75-4dcc-a3f2-fb6fd1b0f677 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1288 microversion: 2.1 time: 0.090930 Dec 15 14:17:46.849489 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 341/668] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:46 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:47.003786 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:47.004534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:47.011905 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.012384 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:47.013183 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.013619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:47.425818 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:47.433889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5d55ed13-db42-4e90-af5a-7d0f900f53bf tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.434240 Dec 15 14:17:47.434458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 328/669] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:46 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:47.684666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:47.685580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:47.691895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.692370 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:47.693141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.693573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:47.765066 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-646f7a70-8712-463f-9af3-448b60df93fd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.083499 Dec 15 14:17:47.765731 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 342/670] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:47 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:47.866108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:47.866753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:47.874153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.874609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:47.875396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:47.875909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.101662 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:48.109289 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-83dc4a14-4216-4ad5-9509-27f18696e27c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.246938 Dec 15 14:17:48.109978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 329/671] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:47 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:48.454012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:48.454725 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:48.462793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:48.463234 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.464143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:48.464530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.536545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-107c5eb4-a7d8-4509-a4da-a45b504fdf89 req-cd14ac1a-e466-4942-a86e-83eca7f48e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbf4fc8-88c2-4070-a5ff-5e5845affa90", "tag": "4732b8b2-cc35-4586-a6eb-d32aa6c61027"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:48.538612 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:48.538612 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:48.548048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-107c5eb4-a7d8-4509-a4da-a45b504fdf89 req-cd14ac1a-e466-4942-a86e-83eca7f48e17 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:48.548760 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-107c5eb4-a7d8-4509-a4da-a45b504fdf89 req-cd14ac1a-e466-4942-a86e-83eca7f48e17 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.561633 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-107c5eb4-a7d8-4509-a4da-a45b504fdf89 req-cd14ac1a-e466-4942-a86e-83eca7f48e17 service nova] Creating event network-changed:4732b8b2-cc35-4586-a6eb-d32aa6c61027 for instance 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 on hv-cinder-81322 Dec 15 14:17:48.566311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-107c5eb4-a7d8-4509-a4da-a45b504fdf89 req-cd14ac1a-e466-4942-a86e-83eca7f48e17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033943 Dec 15 14:17:48.567030 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 330/672] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:17:48.760007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:48.769085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fcf9082f-82f3-45ca-9afb-0654943a8e22 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.319943 Dec 15 14:17:48.769772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 343/673] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:48 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:48.775828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:48.776914 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:48.786272 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:48.786800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.787648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:48.788181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:48.859039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3181e555-4421-49cf-bd44-1b166b1fee0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.086966 Dec 15 14:17:48.862420 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 331/674] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:48 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:49.127058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:49.127761 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:49.134478 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.135141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.136153 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.136672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.354306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:49.361672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-37e0ed8f-0cb7-40e1-9e33-80dedfed98c3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.238965 Dec 15 14:17:49.362276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 344/675] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:49 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:49.787133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:49.787865 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:49.796370 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.796828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.797622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.798123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.869715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:49.870623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:49.877198 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.877744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.878595 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:49.879036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:49.945522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:49.953959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-61a8d4e4-deac-467e-95c1-d2378d962490 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.170952 Dec 15 14:17:49.954536 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 332/676] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:49 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:49.955814 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2ec263ca-d95a-4754-b1b8-1fc84de2010f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.089629 Dec 15 14:17:49.956638 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 345/677] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:49 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:50.379040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:50.379650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:50.385978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.386418 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:50.387185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.387618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:50.524390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:50.531652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b05f741d-75b6-4c6f-9e91-4fd576fd0b55 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.156387 Dec 15 14:17:50.532322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 333/678] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:50 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:50.967612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:50.968631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:50.970783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:50.971459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:50.975511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.976068 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:50.977216 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.977656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:50.977869 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.978314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:50.979083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:50.979511 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:51.121780 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:51.129717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b57634ba-b8e8-4147-99b4-daf787056417 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.163300 Dec 15 14:17:51.130275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 334/679] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:50 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:51.548484 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:51.549083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:51.555363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:51.555806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:51.556616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:51.557054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:51.689743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:51.697005 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2a8da411-525d-47e8-9b2c-9c435d8bbb31 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.152140 Dec 15 14:17:51.697503 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 335/680] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:51 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:52.147551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:52.148203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:52.154180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:52.155279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:52.156033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:52.156474 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:52.298942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:52.306638 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6140530a-e090-49dc-bb89-2ea8b3082049 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.162946 Dec 15 14:17:52.307233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 336/681] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:52 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:52.714572 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:52.715196 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:52.721644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:52.722095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:52.722871 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:52.723309 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:52.853986 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:52.861791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-035ce201-68f7-472b-aa28-3934835f0ac9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.151146 Dec 15 14:17:52.862354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 337/682] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:52 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:53.323316 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:53.323966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:53.330501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:53.330952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:53.331717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:53.332180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:53.475647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:53.483609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1d6eb92d-a4f4-4cd7-af77-3fdc6e29010c tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.164012 Dec 15 14:17:53.484196 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 338/683] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:53 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:53.733389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-19cf96b3-04ab-44d5-86ae-f374ce94abad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 2.770196 Dec 15 14:17:53.734148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 346/684] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:50 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:53.879282 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:53.879891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:53.886152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:53.886594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:53.887363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:53.887791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:54.020880 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:54.028509 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dcac3bd3-adf9-483a-bc65-ff69c4d8e905 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.152874 Dec 15 14:17:54.029087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 339/685] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:53 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:54.501959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:54.502646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:54.510071 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:54.510512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:54.511276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:54.511700 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:54.659250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:54.667285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e0886990-a28d-4fcd-989b-31f1946df90f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.169989 Dec 15 14:17:54.667871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 347/686] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:54 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:54.744260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:54.745165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:54.751199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:54.751653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:54.760496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:54.760496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:54.817588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-45958338-3574-4b09-8362-19bec94c28c5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 14 microversion: 2.20 time: 0.076836 Dec 15 14:17:54.818182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 340/687] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:54 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:55.045753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:55.046558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:55.053020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.053462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.054229 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.054659 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.195677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:55.204895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-108271dc-7554-4529-8fd1-f5ba2315fd57 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.162914 Dec 15 14:17:55.205637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 348/688] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:55 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:55.685977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:55.686676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:55.694342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.694792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.695571 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.696044 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.828578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:55.829493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:55.835633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.838697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.838697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:55.838697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:55.845638 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:55.853915 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-42621908-e2cb-426a-914d-296445f20766 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.172099 Dec 15 14:17:55.854487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 341/689] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:55 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:55.909112 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5f537bf5-1647-4794-8742-2aefad410d68 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 6257 microversion: 2.20 time: 0.084205 Dec 15 14:17:55.909743 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 349/690] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:55 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 6257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:17:56.222864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:56.223556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:56.230111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.230640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:56.231428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.231865 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:56.361380 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:56.368680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f342ed6a-acd2-4eed-87df-5cae6aae1efc tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.150218 Dec 15 14:17:56.369185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 342/691] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:56 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:56.871881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:56.872618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:56.880027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.880470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:56.881253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.881678 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:56.921219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:56.922156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:56.928713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.932184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:56.932184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:56.932184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:57.010412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c2b9471c-2acc-43a8-9ebe-0678f1de642d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 13311 microversion: 2.20 time: 0.093031 Dec 15 14:17:57.011011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 343/692] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:56 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 13311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:57.020732 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-98cdedaa-3146-44c9-a91f-9aea81226079 req-15b8dbc7-7805-4316-a5b9-b5bca138580e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbf4fc8-88c2-4070-a5ff-5e5845affa90", "name": "network-vif-plugged", "status": "completed", "tag": "4732b8b2-cc35-4586-a6eb-d32aa6c61027"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:57.025752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:17:57.025752 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:17:57.033641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-98cdedaa-3146-44c9-a91f-9aea81226079 req-15b8dbc7-7805-4316-a5b9-b5bca138580e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:57.034084 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-98cdedaa-3146-44c9-a91f-9aea81226079 req-15b8dbc7-7805-4316-a5b9-b5bca138580e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:57.036221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:57.044568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ae15fdaf-b03b-4577-9d67-06bd6e2ad721 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.176778 Dec 15 14:17:57.052177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 350/693] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:56 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:57.052305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-98cdedaa-3146-44c9-a91f-9aea81226079 req-15b8dbc7-7805-4316-a5b9-b5bca138580e service nova] Creating event network-vif-plugged:4732b8b2-cc35-4586-a6eb-d32aa6c61027 for instance 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 on hv-cinder-81322 Dec 15 14:17:57.057707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-98cdedaa-3146-44c9-a91f-9aea81226079 req-15b8dbc7-7805-4316-a5b9-b5bca138580e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043110 Dec 15 14:17:57.058308 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 344/694] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:17:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:17:57.385300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:57.385913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:57.392198 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:57.392656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:57.393448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:57.393883 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:57.526518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:57.534311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-770b992a-5600-4bd8-95d6-2d22885ee352 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.152748 Dec 15 14:17:57.534886 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 351/695] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:57 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:58.023278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:58.024235 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:58.030362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.030817 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.032225 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.032761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.062437 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:58.063604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:58.069872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.070316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.071119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.071547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.103099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-04d40602-78a2-419d-aaf0-d72fc2324097 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 17933 microversion: 2.20 time: 0.084310 Dec 15 14:17:58.104038 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 345/696] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:58 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 17933 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:17:58.215899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:58.223619 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-23112b65-a363-4fbd-916e-ea2cd2f64666 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.165048 Dec 15 14:17:58.224218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 352/697] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:58 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:17:58.554875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:58.555596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:58.562615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.563753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.564564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:58.564998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:58.703578 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:58.710733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d7891f35-d455-4269-a1d8-b9b0895c1c74 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1318 microversion: 2.1 time: 0.159919 Dec 15 14:17:58.714955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 346/698] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:58 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:59.114007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:59.114830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:59.121911 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.123543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.123543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.123543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.209508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ca311cf0-2bae-453b-b096-113fdaa1651b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 18449 microversion: 2.20 time: 0.099217 Dec 15 14:17:59.210149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 353/699] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:17:59 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 18449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:17:59.241632 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:59.242243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:59.248698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.249149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.249930 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.250494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.394813 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:59.402948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b67a1c6c-4093-4203-a365-a07b734d7dcc tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.165075 Dec 15 14:17:59.403564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 347/700] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:59 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:59.729056 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:17:59.729896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:59.737298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.742232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.742232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.742232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.874234 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:17:59.882387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8313a321-e7f9-442a-b8c2-485051b769e0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1508 microversion: 2.1 time: 0.158097 Dec 15 14:17:59.882942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 354/701] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:17:59 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:17:59.899835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bb6d27e-e075-4414-bf02-901ce6ba1996"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:17:59.900921 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:17:59.908537 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.908537 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.909362 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:17:59.909798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:17:59.993925 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Invalid volume: volume 4bb6d27e-e075-4414-bf02-901ce6ba1996 is already attached to instances: 6facd328-628c-4075-b7e0-685acaf6112d Dec 15 14:17:59.994528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 400 to user: Invalid volume: volume 4bb6d27e-e075-4414-bf02-901ce6ba1996 is already attached to instances: 6facd328-628c-4075-b7e0-685acaf6112d {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:17:59.997291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8d42f9f2-4eb1-40d9-8be7-a608faf0e4d0 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099436 Dec 15 14:17:59.997291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 348/702] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:17:59 2021] POST /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:18:00.053273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:00.053840 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:00.060152 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.060595 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.061365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.061797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.152453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'services' on Instance uuid 6facd328-628c-4075-b7e0-685acaf6112d {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:18:00.221040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:00.222026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:00.229019 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.229516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.230303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.230753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.316487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2f538599-ed91-42a9-b435-52b5a14f3b8b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 20990 microversion: 2.20 time: 0.098942 Dec 15 14:18:00.317647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 349/703] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:00 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 20990 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:00.350613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-678e3fa4-5b6b-4309-aa60-5fe223049f30 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments/4bb6d27e-e075-4414-bf02-901ce6ba1996" status: 202 len: 0 microversion: 2.1 time: 0.300918 Dec 15 14:18:00.351230 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 355/704] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:18:00 2021] DELETE /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments/4bb6d27e-e075-4414-bf02-901ce6ba1996 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:00.360849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:00.361885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:00.368875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.369329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.370115 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.370565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.400269 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a8b473fb-1edc-46c8-a704-8ca2a562066c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Dec 15 14:18:00.400838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 350/705] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:00 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:00.422738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:00.424130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:00.430129 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.430565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.431368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:00.431836 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:00.581474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:00.589145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-626fbdfd-1e83-47a7-8710-dd231941490d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1754 microversion: 2.1 time: 0.171949 Dec 15 14:18:00.589709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 356/706] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:00 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:01.326953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:01.327854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:01.336566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.337017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.337790 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.338223 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.413176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:01.414194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:01.420655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.421103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.421977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.422644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.435744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5d386828-d7ae-402b-b54e-c8ea83d0fc54 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 22161 microversion: 2.20 time: 0.112282 Dec 15 14:18:01.436787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 351/707] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:01 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 22161 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:01.457810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-edc48829-fd2f-4b79-b8eb-829cad8490a1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049405 Dec 15 14:18:01.458422 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 357/708] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:01 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:18:01.607297 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:01.608149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:01.615032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.615543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.616360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:01.616793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:01.768448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:01.777144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-be10423e-a576-4e8a-8b3f-4b749091aea0 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1757 microversion: 2.1 time: 0.174002 Dec 15 14:18:01.777707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 352/709] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:01 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:02.447021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:02.447980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:02.454599 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:02.455045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:02.455826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:02.456296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:02.472036 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:02.474132 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:02.480975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:02.481534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:02.482463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:02.482971 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:02.513954 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-617dc31a-9f83-43a0-a0d1-42c9f02dd2ab tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046747 Dec 15 14:18:02.514509 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 353/710] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:02 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:02.543424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ad60372f-962b-4a2b-b23f-bc14d38bffd1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 23597 microversion: 2.20 time: 0.099880 Dec 15 14:18:02.544176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 358/711] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:02 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 23597 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:02.620270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-885055417", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "0ca1363a-730e-4e8b-a82f-8b7d81e5a05c"}]}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:02.670124 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] validate_networks() for [('0ca1363a-730e-4e8b-a82f-8b7d81e5a05c', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:18:03.043391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:18:03.043816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:18:03.044319 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:18:03.044729 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:18:03.045292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:18:03.055649 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:03.056145 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:03.057023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:03.057465 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:03.073785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:03.078718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for user 85e8dd95f1734cf496ebf2addbe7cb4c and project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:03.089571 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:18:03.092007 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:18:03.192858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-18bfb118-e8b0-4a0f-b5c2-77315a9cf54e tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576380 Dec 15 14:18:03.193439 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 354/712] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:18:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:18:03.204094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f6f2cfc6-2f84-4680-a676-161f8f06b0b7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:03.204796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f6f2cfc6-2f84-4680-a676-161f8f06b0b7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:03.270211 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f6f2cfc6-2f84-4680-a676-161f8f06b0b7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:03.277985 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f6f2cfc6-2f84-4680-a676-161f8f06b0b7 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1217 microversion: 2.1 time: 0.078390 Dec 15 14:18:03.278558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 359/713] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:03 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:03.556861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:03.557830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:03.564841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:03.565287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:03.566053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:03.566489 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:03.650296 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1c5278f3-b6d5-43ab-b82c-d82e434d8f0f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 24643 microversion: 2.20 time: 0.097947 Dec 15 14:18:03.654051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 355/714] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:03 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 24643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:04.296122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:04.296769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:04.303331 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:04.303778 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:04.304578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:04.305021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:04.363939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:04.371688 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-911618d4-522b-41e1-9c45-fb30e8925c48 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1221 microversion: 2.1 time: 0.079359 Dec 15 14:18:04.372473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 360/715] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:04 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:04.662643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:04.663625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:04.670512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:04.670967 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:04.672457 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:04.672806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:04.769872 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1dbfb11b-45e7-4365-8e79-3ab3a2578d6d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 25785 microversion: 2.20 time: 0.111206 Dec 15 14:18:04.770487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 356/716] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:04 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 25785 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:05.389021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:05.389637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:05.396369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:05.396852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:05.397872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:05.398252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:05.502536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:05.511227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a6152598-4ce6-4463-82eb-ee34c8266f33 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1287 microversion: 2.1 time: 0.125793 Dec 15 14:18:05.513849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 361/717] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:05 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:05.782066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:05.783123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:05.789973 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:05.790427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:05.791267 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:05.791702 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:05.885085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-021e331d-f9d7-4f95-818b-8dcd7cd8a5d7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 26741 microversion: 2.20 time: 0.107635 Dec 15 14:18:05.885742 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 357/718] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:05 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 26741 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:06.528871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:06.529518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:06.536563 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:06.537016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:06.537866 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:06.538307 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:06.762067 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:06.770755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-37258c0b-92ce-4b63-b56a-a8e061c3df28 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.245592 Dec 15 14:18:06.771402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 362/719] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:06 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:06.898556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:06.899452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:06.907254 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:06.907698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:06.908568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:06.914472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:06.985170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-cfa19c0e-9f71-4593-a01e-64bfc400a31c req-5471472e-3e6c-4b49-80c9-ef16cfccc362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3ea596-c41d-460f-b7d1-95a563510fc8", "tag": "17f63216-6143-430c-bb51-161f509fb578"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:06.987264 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:06.987264 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:06.994642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-cfa19c0e-9f71-4593-a01e-64bfc400a31c req-5471472e-3e6c-4b49-80c9-ef16cfccc362 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:06.995319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-cfa19c0e-9f71-4593-a01e-64bfc400a31c req-5471472e-3e6c-4b49-80c9-ef16cfccc362 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:06.997543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-261a17e1-17e9-4472-990a-002ddf961c08 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 27427 microversion: 2.20 time: 0.103177 Dec 15 14:18:06.998782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 358/720] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:06 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 27427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:07.016095 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-cfa19c0e-9f71-4593-a01e-64bfc400a31c req-5471472e-3e6c-4b49-80c9-ef16cfccc362 service nova] Creating event network-changed:17f63216-6143-430c-bb51-161f509fb578 for instance 2c3ea596-c41d-460f-b7d1-95a563510fc8 on hv-cinder-81322 Dec 15 14:18:07.021381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-cfa19c0e-9f71-4593-a01e-64bfc400a31c req-5471472e-3e6c-4b49-80c9-ef16cfccc362 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040203 Dec 15 14:18:07.022003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 363/721] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:18:07.798462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:07.798462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:07.798462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:07.798462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:07.799035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:07.799035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:08.002203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:08.011002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:08.012019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:08.020178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:08.020627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:08.021413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:08.021849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:08.029584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e2abbe17-a582-469c-9a6d-e67f7530f16f tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.244731 Dec 15 14:18:08.030169 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 359/722] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:07 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:08.119983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-eb0a9805-3044-4c9f-b142-0c83a5627244 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 27784 microversion: 2.20 time: 0.113331 Dec 15 14:18:08.120668 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 364/723] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:08 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 27784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:09.047032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:09.047648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:09.054109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:09.054565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:09.055352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:09.055791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:09.132234 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:09.133350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:09.140094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:09.141102 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:09.142080 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:09.142647 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:09.208893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:09.216921 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c2871f7e-fc0a-49ea-8420-e162fd1204cb tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.173713 Dec 15 14:18:09.217794 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 360/724] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:09 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:09.252680 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ec02741a-7452-434a-bc5d-e4908b44ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 27967 microversion: 2.20 time: 0.125205 Dec 15 14:18:09.255509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 365/725] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:09 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 27967 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:10.235332 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:10.235957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:10.242456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:10.242897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:10.243783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:10.244236 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:10.267612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:10.268876 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:10.279790 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:10.280602 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:10.281469 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:10.282122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:10.371609 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3b2cf5d4-1816-475c-bb81-cee8bf221b37 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28205 microversion: 2.20 time: 0.109317 Dec 15 14:18:10.372573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 366/726] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:10 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28205 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:10.528646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:10.537613 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-06cf6890-22a4-4847-85cd-0bf382d7f818 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.306770 Dec 15 14:18:10.538222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 361/727] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:10 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:11.384796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:11.385855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:11.393794 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:11.394241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:11.395027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:11.395460 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:11.481215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9e6a9448-1ddc-4991-8e9c-d5deb17edfb5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28330 microversion: 2.20 time: 0.100375 Dec 15 14:18:11.485297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 367/728] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:11 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:11.554888 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:11.556157 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:11.562692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:11.563575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:11.564563 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:11.565280 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:11.809870 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:11.817982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e2621b76-58cc-49e9-a685-23ba1633af2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.267041 Dec 15 14:18:11.821571 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 362/729] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:11 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:12.498885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:12.501465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:12.508654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:12.509367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:12.510334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:12.510769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:12.614006 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-53df78f1-aa3b-4361-bfb1-ddc91eb968df tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28496 microversion: 2.20 time: 0.124354 Dec 15 14:18:12.618599 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 368/730] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:12 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28496 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:12.835608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:12.836385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:12.844315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:12.845006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:12.845828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:12.846641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:13.026959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:13.040081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0783e36f-2de8-4301-b41e-987bf48fe220 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.208662 Dec 15 14:18:13.042017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 363/731] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:12 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:13.119254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-a786ccda-e483-4af2-a747-c96275c3c698 req-b82551c8-f62c-4ba9-af05-d1ac5d465a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3ea596-c41d-460f-b7d1-95a563510fc8", "name": "network-vif-plugged", "status": "completed", "tag": "17f63216-6143-430c-bb51-161f509fb578"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:13.121553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:13.121553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:13.132024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-a786ccda-e483-4af2-a747-c96275c3c698 req-b82551c8-f62c-4ba9-af05-d1ac5d465a1d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:13.132666 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-a786ccda-e483-4af2-a747-c96275c3c698 req-b82551c8-f62c-4ba9-af05-d1ac5d465a1d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:13.158512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-a786ccda-e483-4af2-a747-c96275c3c698 req-b82551c8-f62c-4ba9-af05-d1ac5d465a1d service nova] Creating event network-vif-plugged:17f63216-6143-430c-bb51-161f509fb578 for instance 2c3ea596-c41d-460f-b7d1-95a563510fc8 on hv-cinder-81322 Dec 15 14:18:13.164465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-a786ccda-e483-4af2-a747-c96275c3c698 req-b82551c8-f62c-4ba9-af05-d1ac5d465a1d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050251 Dec 15 14:18:13.165181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 369/732] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:13.627374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:13.630217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:13.634848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:13.635311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:13.636373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:13.637227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:13.949275 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1446bc9b-e6d8-4bb2-82c9-0f0eeff3b0d8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28663 microversion: 2.20 time: 0.326794 Dec 15 14:18:13.949929 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 364/733] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:13 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28663 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:14.059758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:14.060557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:14.067257 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:14.067728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:14.068591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:14.069203 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:14.433059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:14.440365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5e901b84-0c8f-4229-9cfa-0ed74249c18b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1317 microversion: 2.1 time: 0.385360 Dec 15 14:18:14.440936 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 370/734] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:14 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:14.962589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:14.969154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:14.971368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:14.971917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:14.972793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:14.973321 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:15.061850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5b1823b1-6b2c-492a-aee3-4b3bf3c1705a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28663 microversion: 2.20 time: 0.103957 Dec 15 14:18:15.063902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 365/735] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:14 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28663 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:15.458596 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:15.459364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:15.465898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:15.466349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:15.467144 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:15.467583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:15.668865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:15.678288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-921ba5d5-4965-453f-aaa3-b278e69d1434 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1506 microversion: 2.1 time: 0.223565 Dec 15 14:18:15.690810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 371/736] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:15 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:16.075602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:16.076712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:16.105436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.107068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.113731 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:16.115506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:16.217391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-db176f21-dade-4d02-90e9-2367c0ae7986 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28663 microversion: 2.20 time: 0.146183 Dec 15 14:18:16.218856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 366/737] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:16 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:17.353850 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:17.355629 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:17.364644 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.368396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.368396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.368396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.426085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd6a7433-9598-47ed-9fb2-0868d238e419"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:17.427150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:17.436826 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.437878 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.438889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:17.439527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:17.449803 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d6573da0-b353-4377-807f-5c44ec09534e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28663 microversion: 2.20 time: 0.223634 Dec 15 14:18:17.450991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 372/738] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:17 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28663 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:18.218039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1f67bd5e-676c-4c55-b6b6-fa463b664990 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796418 Dec 15 14:18:18.219429 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 367/739] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:18:17 2021] POST /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:18:18.463944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:18.465648 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:18.483622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:18.494625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:18.511865 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:18.512618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:18.620547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc443844-6e77-42dc-932d-bbb04cbda9c2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 28663 microversion: 2.20 time: 0.160832 Dec 15 14:18:18.624323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 373/740] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:18 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 28663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:19.633185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:19.636418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:19.641472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:19.641888 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:19.642676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:19.643101 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:19.697010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Action: 'create', calling method: .version_select at 0x7f9cbe425b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-349670718"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:19.713040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:19.717143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for user e5b912c8f0524ebcb586198f3ef88ae3 and project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:19.742448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9dcb12d5-f890-4c09-853b-fe10118b8a8f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 29471 microversion: 2.20 time: 0.113348 Dec 15 14:18:19.752068 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 374/741] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:19 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 29471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:20.001906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:20.008550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for user e5b912c8f0524ebcb586198f3ef88ae3 and project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'key_pairs'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:20.031398 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8f478c57-d0b0-46ae-9a31-65573f0811d2 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.448408 Dec 15 14:18:20.032007 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 368/742] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 14:18:19 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:20.088396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:20.089399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:20.097799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.098490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.103156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.103156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.136261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5ed67ea6-467a-4853-87a5-23da84e59a81 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052090 Dec 15 14:18:20.136860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 375/743] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:20 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:20.199986 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:20.200681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:20.208152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.208900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.209778 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.210291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.242206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Going to try to terminate instance {{(pid=116681) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:18:20.578201 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fa600ec3-7747-4942-a508-1b5f045c5e64 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 204 len: 0 microversion: 2.1 time: 0.381241 Dec 15 14:18:20.579078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 369/744] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:18:20 2021] DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:18:20.587455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:20.588139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:20.595471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.595954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.596799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.597265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.731410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:20.739063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fdb39cb2-9423-4a33-94f5-2144ae15363e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1671 microversion: 2.1 time: 0.155427 Dec 15 14:18:20.739694 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 376/745] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:20 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:20.756163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:20.757165 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:20.764527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.765040 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.766421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:20.767026 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:20.860373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c24e01a2-2c6e-4bd7-ae0f-a551c8a629d0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 30922 microversion: 2.20 time: 0.108208 Dec 15 14:18:20.864335 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 370/746] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:20 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 30922 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:21.756646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:21.757958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:21.764614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.765749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.766553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.767164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.872671 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:21.874282 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:21.882308 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.883000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.883975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:21.884576 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:21.989251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f8ab4821-3c4f-4131-81d9-0bb374883df8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 32023 microversion: 2.20 time: 0.120165 Dec 15 14:18:21.991834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 371/747] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:21 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 32023 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:21.999090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:22.011658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-52cb7331-a494-4237-bde1-327a1c761c3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1671 microversion: 2.1 time: 0.259017 Dec 15 14:18:22.020553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 377/748] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:21 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:23.003740 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:23.006486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:23.013897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.014339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:23.016440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.016889 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:23.029573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:23.031074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:23.037300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.038039 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:23.038842 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:23.039276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:23.128458 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-166f3df4-a6d0-4175-89e4-b48c1624dd40 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 32887 microversion: 2.20 time: 0.129277 Dec 15 14:18:23.129133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 372/749] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:22 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 32887 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:23.188347 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:23.196742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d9d3b4b3-cf4a-424f-a651-feef89880f98 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1671 microversion: 2.1 time: 0.170684 Dec 15 14:18:23.206898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 378/750] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:23 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:24.142643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:24.144310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:24.152862 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:24.153281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.154539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:24.155024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.213888 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:24.214477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:24.221701 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:24.222184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.222947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:24.223373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.259884 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-998512a3-5bac-4dec-b6bb-0988458ce752 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 33402 microversion: 2.20 time: 0.122308 Dec 15 14:18:24.261544 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 373/751] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:24 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 33402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:24.562543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:24.570341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-41923e2d-9cfd-4c7f-8b32-7b30fc03b5c3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1603 microversion: 2.1 time: 0.360038 Dec 15 14:18:24.571196 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 379/752] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:24 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1603 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:24.662208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-7f1bdc45-e4cf-452b-8d88-a04439831831 req-eab9cbe7-41d9-48f5-8dc3-6a0b47a2d685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef62bed0-b1e8-4769-878e-4dc0bbb2c15f", "name": "network-vif-deleted", "tag": "7fbad533-96b2-474b-aa8f-d92f5601bf21"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:24.668310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:24.668310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:18:24.672374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-7f1bdc45-e4cf-452b-8d88-a04439831831 req-eab9cbe7-41d9-48f5-8dc3-6a0b47a2d685 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:24.672819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-7f1bdc45-e4cf-452b-8d88-a04439831831 req-eab9cbe7-41d9-48f5-8dc3-6a0b47a2d685 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:24.684150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-7f1bdc45-e4cf-452b-8d88-a04439831831 req-eab9cbe7-41d9-48f5-8dc3-6a0b47a2d685 service nova] Creating event network-vif-deleted:7fbad533-96b2-474b-aa8f-d92f5601bf21 for instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f on hv-cinder-81322 Dec 15 14:18:24.689230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-7f1bdc45-e4cf-452b-8d88-a04439831831 req-eab9cbe7-41d9-48f5-8dc3-6a0b47a2d685 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031174 Dec 15 14:18:24.690152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 374/753] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:25.273862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:25.274757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:25.281690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.282133 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.283100 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.283956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.392993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-53536956-2606-42d3-b9d6-347870871140 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 33797 microversion: 2.20 time: 0.118717 Dec 15 14:18:25.397031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 380/754] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:25 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 33797 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:25.588580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:25.589473 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:25.603186 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.603635 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.604460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.605077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.642252 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.643326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.644212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lazy-loading 'fault' on Instance uuid ef62bed0-b1e8-4769-878e-4dc0bbb2c15f {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:18:25.701198 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:25.710885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-83823be4-0157-42cb-83b9-1806242766fc tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 200 len: 1326 microversion: 2.1 time: 0.126609 Dec 15 14:18:25.711496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 375/755] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:25 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:25.793370 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd6a7433-9598-47ed-9fb2-0868d238e419"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:25.794440 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:25.801591 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.802038 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.802833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.803268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.888140 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Invalid volume: volume dd6a7433-9598-47ed-9fb2-0868d238e419 is already attached to instances: 2c3ea596-c41d-460f-b7d1-95a563510fc8 Dec 15 14:18:25.890625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 400 to user: Invalid volume: volume dd6a7433-9598-47ed-9fb2-0868d238e419 is already attached to instances: 2c3ea596-c41d-460f-b7d1-95a563510fc8 {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:18:25.890625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0a089e0b-5734-4b98-8292-d1901f51948c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101173 Dec 15 14:18:25.890983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 381/756] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:18:25 2021] POST /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:18:25.950033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:25.950555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:25.960583 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.961037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:25.961825 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:25.962256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.039550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'services' on Instance uuid 2c3ea596-c41d-460f-b7d1-95a563510fc8 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:18:26.302648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0767b9cb-8191-4eea-a6f0-b56806832e23 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments/dd6a7433-9598-47ed-9fb2-0868d238e419" status: 202 len: 0 microversion: 2.1 time: 0.356856 Dec 15 14:18:26.303308 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 376/757] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:18:25 2021] DELETE /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments/dd6a7433-9598-47ed-9fb2-0868d238e419 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:26.313405 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:26.314385 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:26.321037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.321497 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.322265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.322699 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.352456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-59681405-e18b-418c-9778-106b574a7544 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Dec 15 14:18:26.352996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 382/758] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:26 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:26.409309 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:26.410363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:26.416600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.417044 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.417825 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.418256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.515672 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1b014194-289c-413f-aa6f-c8c505dd0473 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 34544 microversion: 2.20 time: 0.110522 Dec 15 14:18:26.516347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 377/759] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:26 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 34544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:26.727895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:26.728516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:26.735588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.736063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.736830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:26.737257 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:26.750265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. Dec 15 14:18:26.750972 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:18:26.751805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-82bfedbd-eee7-4468-b323-66ca2bb0eff2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 404 len: 111 microversion: 2.1 time: 0.028025 Dec 15 14:18:26.752378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 383/760] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:26 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:18:26.761144 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-937d9034-97cf-40b7-a3f3-5eb7cf90d350 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '.version_select at 0x7f9cbe144af0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:26.845018 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-937d9034-97cf-40b7-a3f3-5eb7cf90d350 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768295738" status: 202 len: 0 microversion: 2.1 time: 0.087594 Dec 15 14:18:26.847887 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 378/761] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Dec 15 14:18:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768295738 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:27.366209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:27.367197 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:27.373274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.373718 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.374808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.375020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.410845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-39882e61-588f-47e0-8221-b81db42199f5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049786 Dec 15 14:18:27.411475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 384/762] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:27 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:27.527634 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:27.528694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:27.535978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.536431 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.537209 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:27.537643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:27.629709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b8fb0735-807b-470b-b7da-23f1b342ef16 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 35205 microversion: 2.20 time: 0.106066 Dec 15 14:18:27.634070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 379/763] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:27 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 35205 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:27.653411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: .version_select at 0x7f9cbe8059d0>, body: {"keypair": {"name": "tempest-keypair-840361116"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:27.667730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:27.672274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:28.124125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:28.128428 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:28.141537 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-899a5503-afc8-482c-824a-6f9f39d17549 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.491899 Dec 15 14:18:28.142132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 385/764] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 14:18:27 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:28.423791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:28.424815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:28.431865 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.432337 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.433122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.433550 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.463608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4a42a975-7cd0-4efa-aaa2-7384c8c30da2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045114 Dec 15 14:18:28.464198 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 380/765] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:28 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:28.611724 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1996571942", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "0ca1363a-730e-4e8b-a82f-8b7d81e5a05c"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:28.643988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:28.645585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:28.656249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.656249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.656249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:28.656249 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:28.667991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] validate_networks() for [('0ca1363a-730e-4e8b-a82f-8b7d81e5a05c', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:18:28.740434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ad7d271d-03f0-4423-bdb1-13cdf8de083b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 35986 microversion: 2.20 time: 0.101775 Dec 15 14:18:28.741191 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 381/766] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:28 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 35986 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:29.184854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:18:29.185276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:18:29.185775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:18:29.186182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:18:29.186677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:18:29.195694 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.196180 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:29.196990 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.197472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:29.214492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:29.219392 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Getting quotas for user 85e8dd95f1734cf496ebf2addbe7cb4c and project 1fb03627f3cf48e883d03edd35399116. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:29.232125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:18:29.235684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:18:29.339371 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e5176a89-b681-4b3d-afcb-bf53e4e6dfc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731866 Dec 15 14:18:29.340036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 386/767] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:18:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:18:29.351273 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f7ea53da-e312-4e1f-be48-45479b93e3d3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:29.351989 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f7ea53da-e312-4e1f-be48-45479b93e3d3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:29.442124 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f7ea53da-e312-4e1f-be48-45479b93e3d3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:29.450373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f7ea53da-e312-4e1f-be48-45479b93e3d3 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1218 microversion: 2.1 time: 0.102598 Dec 15 14:18:29.451231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 382/768] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:29 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:29.753185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:29.754302 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:29.760373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.760828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:29.761607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:29.762041 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:29.844692 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-069579b8-6d90-4b5c-8f3e-02df40ba2f98 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 36974 microversion: 2.20 time: 0.095126 Dec 15 14:18:29.848809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 387/769] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:29 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 36974 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:30.467819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:30.468903 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:30.475433 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:30.475815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:30.476606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:30.477034 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:30.540284 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:30.548132 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-abb134c8-7bd2-412f-99ae-c73e7618d752 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1222 microversion: 2.1 time: 0.084018 Dec 15 14:18:30.548733 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 383/770] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:30 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:30.569690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-596792687", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de3ac665-6e2b-47fc-8d80-1b730042a6ab"}], "security_groups": [{"name": "tempest-securitygroup--1459224474"}], "key_name": "tempest-keypair-840361116", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:30.672327 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] validate_networks() for [('de3ac665-6e2b-47fc-8d80-1b730042a6ab', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:18:30.856864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:30.858253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:30.867278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:30.867955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:30.868950 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:30.869632 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:30.951233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c9cf2b36-701c-493f-bfe7-2a148f7be143 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 37885 microversion: 2.20 time: 0.098084 Dec 15 14:18:30.951882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 384/771] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:30 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 37885 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:31.066924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:18:31.067411 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:18:31.067820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:18:31.068263 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:18:31.068664 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:18:31.078552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.078992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.079828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.080331 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.104804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for project 99e48568027f45a591f092080d89b4dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:31.109329 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Getting quotas for user efb651a254f441faa4e2588144cb2530 and project 99e48568027f45a591f092080d89b4dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:31.122473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:18:31.125742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:18:31.247642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1ccac5d2-478b-404e-9ee9-09c1c893b6a2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682381 Dec 15 14:18:31.248376 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 388/772] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:18:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:18:31.259501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-eae83e66-d229-446b-ab7b-199fc08da295 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:31.260292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-eae83e66-d229-446b-ab7b-199fc08da295 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:31.317279 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-eae83e66-d229-446b-ab7b-199fc08da295 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:31.323839 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-eae83e66-d229-446b-ab7b-199fc08da295 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1236 microversion: 2.1 time: 0.068353 Dec 15 14:18:31.324576 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 385/773] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:31 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:31.565893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:31.566499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:31.572898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.573277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.574044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.574509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.650345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:31.666359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d51c1508-a3cf-4fa1-9447-bc839b7f6d8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1278 microversion: 2.1 time: 0.100331 Dec 15 14:18:31.674846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 389/774] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:31 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:31.964615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:31.965536 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:31.972619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.973070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:31.973893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:31.974424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.069983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2ed2bfb6-ad5a-4ebf-b712-6e289e7dd94d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 38203 microversion: 2.20 time: 0.109239 Dec 15 14:18:32.070747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 386/775] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:31 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 38203 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:32.340987 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:32.346572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:32.362155 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.362839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.363874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.364365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.426710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:32.434101 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-07e410be-45f6-432e-a499-d5c172075d74 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1240 microversion: 2.1 time: 0.096872 Dec 15 14:18:32.434670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 390/776] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:32 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:32.686996 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:32.687680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:32.695129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.695573 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.697149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:32.697708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:32.916141 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:32.923663 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c17e0a96-3aee-49e6-b089-8446573c0aee tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.241027 Dec 15 14:18:32.924260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 387/777] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:32 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:33.082340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:33.083336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:33.089606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.090052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.090838 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.091296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.192406 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8e6335a1-fc5c-4c53-852b-332a6e3e4107 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 38203 microversion: 2.20 time: 0.113603 Dec 15 14:18:33.196632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 391/778] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:33 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 38203 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:33.442711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-7b5d1b9b-39f8-4cd5-928e-dfe61efd877d req-b46b4a2b-9128-47a1-a72a-ed565d0fbdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25314db9-9fee-46eb-8a55-fa7aaa694630", "tag": "09266547-aec9-4ddd-b235-14a60e8aa3cb"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:33.445012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:33.445012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:18:33.453645 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-7b5d1b9b-39f8-4cd5-928e-dfe61efd877d req-b46b4a2b-9128-47a1-a72a-ed565d0fbdd4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.454422 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-7b5d1b9b-39f8-4cd5-928e-dfe61efd877d req-b46b4a2b-9128-47a1-a72a-ed565d0fbdd4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.457026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:33.460333 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:33.467446 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-7b5d1b9b-39f8-4cd5-928e-dfe61efd877d req-b46b4a2b-9128-47a1-a72a-ed565d0fbdd4 service nova] Creating event network-changed:09266547-aec9-4ddd-b235-14a60e8aa3cb for instance 25314db9-9fee-46eb-8a55-fa7aaa694630 on hv-cinder-81322 Dec 15 14:18:33.473045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-7b5d1b9b-39f8-4cd5-928e-dfe61efd877d req-b46b4a2b-9128-47a1-a72a-ed565d0fbdd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097643 Dec 15 14:18:33.474152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 388/779] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:33.475605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.477528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.477528 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.477714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.564094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:33.571558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4b2d70c4-383d-4fb6-9b8a-a62c60739a9c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1296 microversion: 2.1 time: 0.122977 Dec 15 14:18:33.572450 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 392/780] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:33 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:33.941407 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:33.942228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:33.948482 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.948926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:33.949694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:33.950123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.205021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:34.206171 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:34.212766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.213225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.214036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.214457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.292939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5e41878f-549c-45cb-b80a-0ae57377f992 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 200 len: 38344 microversion: 2.20 time: 0.091941 Dec 15 14:18:34.298553 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 393/781] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:34 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 38344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:18:34.303963 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:34.304626 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:34.311254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.312755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.313550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.313989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.343669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4ba0920d-79fb-4ab2-b15a-d4354da89471 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/ips" status: 200 len: 150 microversion: 2.20 time: 0.043358 Dec 15 14:18:34.347977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 394/782] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Dec 15 14:18:34 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:18:34.542205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:34.550326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ba7ef346-ccf4-49bc-8dd6-b24dc63d90b5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.613887 Dec 15 14:18:34.551013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 389/783] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:33 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:34.591664 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:34.597515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:34.605212 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.605669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.606490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:34.606927 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:34.691223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:34.698677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f521242c-9441-4e25-a183-0250881c6a72 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1294 microversion: 2.1 time: 0.111184 Dec 15 14:18:34.699244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 395/784] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:34 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:35.567953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:35.568644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:35.575214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.575657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:35.576465 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.576896 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:35.715603 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:35.716253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:35.726522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.727011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:35.731512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:35.732246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:35.759835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:35.767596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-93ef9514-3e00-4498-9c07-2eea06e0f996 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.204244 Dec 15 14:18:35.768944 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 390/785] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:35 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:35.990911 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:35.999817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0b327acd-c0e8-45ca-a2f5-d8f59ef1978b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.287928 Dec 15 14:18:36.000443 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 396/786] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:35 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:36.211138 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5017caff-b8b0-4b59-a158-93dffccc8b77 req-31ce1598-c84c-4e2b-bfb9-6974c5792fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad61711-58ee-4f49-8b73-a7879a8743ee", "tag": "a281319e-ef68-4dae-9da6-2e3cb6b4f56a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:36.213129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:36.213129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:18:36.222440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5017caff-b8b0-4b59-a158-93dffccc8b77 req-31ce1598-c84c-4e2b-bfb9-6974c5792fce service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:36.223313 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5017caff-b8b0-4b59-a158-93dffccc8b77 req-31ce1598-c84c-4e2b-bfb9-6974c5792fce service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.239411 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5017caff-b8b0-4b59-a158-93dffccc8b77 req-31ce1598-c84c-4e2b-bfb9-6974c5792fce service nova] Creating event network-changed:a281319e-ef68-4dae-9da6-2e3cb6b4f56a for instance 0ad61711-58ee-4f49-8b73-a7879a8743ee on hv-cinder-81322 Dec 15 14:18:36.244916 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5017caff-b8b0-4b59-a158-93dffccc8b77 req-31ce1598-c84c-4e2b-bfb9-6974c5792fce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037716 Dec 15 14:18:36.245525 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 391/787] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:36.785428 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:36.785970 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:36.792463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:36.792907 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.793713 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:36.794141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.949414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:36.949414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:36.966057 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:36.966542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.967292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:36.967778 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:36.992506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lazy-loading 'flavor' on Instance uuid dba5304f-71f5-478d-9a3b-80f90a1cbb9c {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:18:37.013933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.023659 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6ebc3b81-4ab3-48a4-91d8-51b3540c1530 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.241945 Dec 15 14:18:37.024791 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 397/788] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:36 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:37.030026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:37.031398 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:37.038633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.039017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.039950 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.040418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.191298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.199084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0ad17aad-6b81-4c79-921b-40c14078d633 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.172767 Dec 15 14:18:37.199649 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 398/789] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:37 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:37.599775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3bb695f0-fa8b-4925-adf2-c68ee056de38 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 202 len: 0 microversion: 2.20 time: 0.659501 Dec 15 14:18:37.600584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 392/790] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:18:36 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:18:37.609298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:37.610550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:37.617550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.618082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.619076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:37.619583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:37.754276 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.762315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.763868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:37.765620 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-31967b93-613c-4d25-8995-0942ed5f657a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.160519 Dec 15 14:18:37.766086 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 399/791] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:37 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:38.042743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:38.043442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:38.049691 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.050140 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.050919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.051354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.185643 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.193656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-688fcd05-1777-4736-84f1-a51e8304e713 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.155374 Dec 15 14:18:38.194227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 393/792] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:38 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:38.215958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:38.216655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:38.222764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.230464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.230464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.230464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.354202 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.362108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5a758154-8400-4444-ac2e-9afcba3a7e3a tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.149877 Dec 15 14:18:38.362685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 400/793] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:38 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:38.783952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:38.784519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:38.790406 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.790855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.791630 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:38.792099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:38.919854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.928156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.929677 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:38.931000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-800b6c45-c950-4e85-aed2-af324eb9e50a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.151088 Dec 15 14:18:38.931558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 394/794] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:38 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:39.134519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-4b071da9-766a-49d7-a205-9a4150de915b req-4fa403bc-dc3c-42b7-9027-300b8cd2277c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25314db9-9fee-46eb-8a55-fa7aaa694630", "name": "network-vif-plugged", "status": "completed", "tag": "09266547-aec9-4ddd-b235-14a60e8aa3cb"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:39.136358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:39.136358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:39.143749 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b071da9-766a-49d7-a205-9a4150de915b req-4fa403bc-dc3c-42b7-9027-300b8cd2277c service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.144229 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4b071da9-766a-49d7-a205-9a4150de915b req-4fa403bc-dc3c-42b7-9027-300b8cd2277c service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.155364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-4b071da9-766a-49d7-a205-9a4150de915b req-4fa403bc-dc3c-42b7-9027-300b8cd2277c service nova] Creating event network-vif-plugged:09266547-aec9-4ddd-b235-14a60e8aa3cb for instance 25314db9-9fee-46eb-8a55-fa7aaa694630 on hv-cinder-81322 Dec 15 14:18:39.160397 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-4b071da9-766a-49d7-a205-9a4150de915b req-4fa403bc-dc3c-42b7-9027-300b8cd2277c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029597 Dec 15 14:18:39.161149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 401/795] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:39.210656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:39.211356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:39.220952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.221487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.222364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.222924 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.363209 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:39.370562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-287d48f5-6ff9-46c1-99ad-d27d46e729cd tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.163690 Dec 15 14:18:39.371129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 395/796] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:39 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:39.379438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:39.380169 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:39.386271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.386710 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.387483 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.387946 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.572112 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:39.579917 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b55d789a-09c3-44e8-b293-6df7b7389a4e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.204484 Dec 15 14:18:39.580545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 402/797] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:39 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:39.950390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:39.950914 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:39.956993 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.957434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:39.958198 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:39.958626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.088203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.097228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.098838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.100054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-95642fe0-2e60-4727-9dac-38737f349749 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.153651 Dec 15 14:18:40.100642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 396/798] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:39 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:40.387752 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:40.388387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:40.394981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.395420 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.396220 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.396646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.525007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.532908 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2ab3d236-582a-4b23-97b1-132cc2cb4744 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1318 microversion: 2.1 time: 0.148767 Dec 15 14:18:40.533471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 403/799] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:40 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:40.597252 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:40.597789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:40.604268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.604719 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.605493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:40.605927 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:40.737241 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:40.744463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f3a02f41-936c-46ed-b67c-c09d23d960c0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.150902 Dec 15 14:18:40.745051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 397/800] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:40 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:41.120948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:41.121564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:41.128193 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.128645 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.129424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.129860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.263898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.272392 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.273912 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.275048 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-de506e98-2ee4-4235-b2d0-af5f0d854abd tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.160242 Dec 15 14:18:41.275600 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 404/801] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:41 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:41.550423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:41.551110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:41.557046 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.557496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.558404 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.558844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.694000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.702022 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d2634cf8-d71c-4876-8ff6-a1cf57c4112c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1507 microversion: 2.1 time: 0.155313 Dec 15 14:18:41.709184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 398/802] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:41 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:41.760923 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:41.761622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:41.767993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.768511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.769378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:41.769813 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:41.899728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:41.907381 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-55bbef5d-cbd8-4edb-82ba-327f297d7339 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.150118 Dec 15 14:18:41.907982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 405/803] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:41 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:42.300460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:42.305588 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:42.307522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:42.308053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:42.308855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:42.309358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:42.456176 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:42.464206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:42.465805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:42.466969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-85cc3943-d8f3-48b5-a78f-aef772e82644 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.170435 Dec 15 14:18:42.467617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 399/804] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:42 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:42.924026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:42.924637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:42.930885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:42.931492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:42.932307 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:42.932740 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.064883 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:43.072508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a60f5b72-4383-4c42-b30a-1d93000d989c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.152669 Dec 15 14:18:43.073085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 406/805] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:42 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:43.201575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-6049c269-e574-46b8-9424-a0715525c083 req-c885a883-4e89-4137-a4ee-f2edbc4ca50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad61711-58ee-4f49-8b73-a7879a8743ee", "name": "network-vif-plugged", "status": "completed", "tag": "a281319e-ef68-4dae-9da6-2e3cb6b4f56a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:43.203176 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:43.203176 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:18:43.210155 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-6049c269-e574-46b8-9424-a0715525c083 req-c885a883-4e89-4137-a4ee-f2edbc4ca50e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.210596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-6049c269-e574-46b8-9424-a0715525c083 req-c885a883-4e89-4137-a4ee-f2edbc4ca50e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.222749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-6049c269-e574-46b8-9424-a0715525c083 req-c885a883-4e89-4137-a4ee-f2edbc4ca50e service nova] Creating event network-vif-plugged:a281319e-ef68-4dae-9da6-2e3cb6b4f56a for instance 0ad61711-58ee-4f49-8b73-a7879a8743ee on hv-cinder-81322 Dec 15 14:18:43.227706 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-6049c269-e574-46b8-9424-a0715525c083 req-c885a883-4e89-4137-a4ee-f2edbc4ca50e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084212 Dec 15 14:18:43.228312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 400/806] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:43.396060 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc83b166-c832-4844-9a4a-d69fe07894df"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:43.397227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:43.403007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.403456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.407465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.407465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.486264 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:43.486972 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:43.493263 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.493714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.494530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:43.494963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:43.683143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:43.692239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:43.693947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:43.709966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d4682642-2e7e-4f2d-9d23-4ef28005612c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.213650 Dec 15 14:18:43.709966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 401/807] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:43 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:18:43.709966 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1479981396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-349670718", "security_groups": [{"name": "tempest-secgroup-smoke-1632249266"}], "networks": [{"uuid": "8adc4b7c-4fb8-44d4-94da-3a33d3faf6c8"}], "block_device_mapping_v2": [{"uuid": "91aceb5b-8b13-454c-b0f9-9b838ff06ad1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:43.833941 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] validate_networks() for [('8adc4b7c-4fb8-44d4-94da-3a33d3faf6c8', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:18:44.236798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:18:44.237394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:18:44.237694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:18:44.238104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:18:44.238518 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:18:44.247665 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.248153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.249028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.249466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.266247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:18:44.270152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Getting quotas for user e5b912c8f0524ebcb586198f3ef88ae3 and project 5aa37dc44119489f8b5a8292cf40d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:18:44.320764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b4ccedf1-a532-4b9c-a597-fa93d3633a32 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "POST /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928379 Dec 15 14:18:44.321373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 407/808] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:18:43 2021] POST /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:18:44.324959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:18:44.328220 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91aceb5b-8b13-454c-b0f9-9b838ff06ad1',volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:18:44.332056 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:44.336046 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:44.341389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.341841 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.343281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.343895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.484013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.491287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-343987c0-3d08-4257-8e98-64d68e49eb88 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1362 microversion: 2.1 time: 0.163186 Dec 15 14:18:44.491852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 408/809] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:44 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:44.715588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:44.716249 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:44.722702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.723150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.724036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:44.724473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:44.849377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9b76c662-eaee-4b2b-8a0a-10514bfc1921 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.152231 Dec 15 14:18:44.849898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 402/810] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:18:43 2021] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:18:44.856160 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.859770 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bf25bcb4-b690-42a6-b6c8-067fb819117f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:44.860492 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bf25bcb4-b690-42a6-b6c8-067fb819117f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:44.864838 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.866654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.868134 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8292033b-0f0b-444c-b15a-96a58ff7200b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.156318 Dec 15 14:18:44.869047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 409/811] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:44 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:18:44.925611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bf25bcb4-b690-42a6-b6c8-067fb819117f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:44.932701 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bf25bcb4-b690-42a6-b6c8-067fb819117f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1088 microversion: 2.1 time: 0.076625 Dec 15 14:18:44.933436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 403/812] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:44 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:45.507876 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:45.508623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:45.514980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.515377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.516194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.516629 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.650279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:45.659086 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7408aaf8-7ff6-4c70-9072-e26266ee6d42 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1546 microversion: 2.1 time: 0.154875 Dec 15 14:18:45.663170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 410/813] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:45 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:45.676032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:45.676558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:45.682990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.683438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.684267 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.684699 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.765074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-02a04436-54ac-4b75-abae-adf44a5cb2f5 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092019 Dec 15 14:18:45.765870 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 404/814] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Dec 15 14:18:45 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:45.887479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:45.888020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:45.894069 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.894508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.895282 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.895712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.950049 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:45.950715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:45.956795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.957287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:45.958073 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:45.958512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:46.295777 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:46.304905 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c3d0bee5-dc0a-4ce8-9d36-35286c11a515 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1138 microversion: 2.1 time: 0.358416 Dec 15 14:18:46.305682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 405/815] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:45 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1138 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:46.476983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:46.486677 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:46.488523 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:46.489672 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c84296ca-14e7-4e04-8472-d4de07715044 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.605986 Dec 15 14:18:46.490222 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 411/816] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:45 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:47.211514 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:47.212520 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:47.221087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.222042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.223307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.223753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.224614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-61822e0e-8423-4cf9-92c2-861eb13b504d req-e78788da-23da-42c5-bd73-5c16eb2936b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad61711-58ee-4f49-8b73-a7879a8743ee", "tag": "a281319e-ef68-4dae-9da6-2e3cb6b4f56a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:47.226889 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:47.226889 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:47.236303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-61822e0e-8423-4cf9-92c2-861eb13b504d req-e78788da-23da-42c5-bd73-5c16eb2936b4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.236748 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-61822e0e-8423-4cf9-92c2-861eb13b504d req-e78788da-23da-42c5-bd73-5c16eb2936b4 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.268084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-61822e0e-8423-4cf9-92c2-861eb13b504d req-e78788da-23da-42c5-bd73-5c16eb2936b4 service nova] Creating event network-changed:a281319e-ef68-4dae-9da6-2e3cb6b4f56a for instance 0ad61711-58ee-4f49-8b73-a7879a8743ee on hv-cinder-81322 Dec 15 14:18:47.275497 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-61822e0e-8423-4cf9-92c2-861eb13b504d req-e78788da-23da-42c5-bd73-5c16eb2936b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058712 Dec 15 14:18:47.276164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 412/817] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:47.320711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f089612a-1d0c-4252-9343-13d33de9c150 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.112708 Dec 15 14:18:47.321444 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 406/818] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:47 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:47.322805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:47.323507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:47.330656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.331103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.331874 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.332499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.410774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:47.419521 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a241a2f2-aac7-4584-a224-6d9433c49a52 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1204 microversion: 2.1 time: 0.101124 Dec 15 14:18:47.420277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 413/819] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:47 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:47.513711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:47.515281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:47.527381 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.527819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.528860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:47.529466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:47.863509 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:47.871569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:47.873894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:47.875783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-afa6c9e6-0233-46b8-b956-e2e898174c0b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.369472 Dec 15 14:18:47.876376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 407/820] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:47 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:48.332715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:48.334460 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:48.349194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.349194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.349194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.349194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.427588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-185394b4-4108-4399-ae81-c4c5a6611d48 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.099191 Dec 15 14:18:48.428301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 414/821] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:48 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:48.437085 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:48.437710 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:48.444841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.445286 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.446064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.446495 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.665973 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:48.674107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f001d861-e3e1-4183-9a68-852c65fc1e0f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1272 microversion: 2.1 time: 0.241305 Dec 15 14:18:48.674679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 408/822] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:48 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:48.895009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:48.895817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:48.902702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.903156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:48.903953 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:48.904423 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.130508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:49.138784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:49.141023 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:49.142204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9b45e463-f034-4796-ab51-72102ce17504 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.251372 Dec 15 14:18:49.142758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 415/823] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:48 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:49.379245 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-38ba2d8f-0caa-4d6b-a17d-da329a527524 req-8c4bc61e-4be6-425b-b5b7-d48cf531f548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:49.380987 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:49.380987 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:18:49.390115 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-38ba2d8f-0caa-4d6b-a17d-da329a527524 req-8c4bc61e-4be6-425b-b5b7-d48cf531f548 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:49.390859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-38ba2d8f-0caa-4d6b-a17d-da329a527524 req-8c4bc61e-4be6-425b-b5b7-d48cf531f548 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.402866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-38ba2d8f-0caa-4d6b-a17d-da329a527524 req-8c4bc61e-4be6-425b-b5b7-d48cf531f548 service nova] Creating event network-changed:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:18:49.408298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-38ba2d8f-0caa-4d6b-a17d-da329a527524 req-8c4bc61e-4be6-425b-b5b7-d48cf531f548 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032999 Dec 15 14:18:49.409048 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 409/824] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:49.439315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:49.440253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:49.447325 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:49.448005 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.449770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:49.450204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.526653 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0bcf1d0a-2dfa-4f7d-9490-3b3ef6c9f330 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.091383 Dec 15 14:18:49.527301 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 416/825] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:49 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:49.691738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:49.692472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:49.698505 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:49.698953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.699742 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:49.700207 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:49.937794 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:49.945289 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5d3a131b-d6e3-4f60-b20f-2cf25349c2cf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1272 microversion: 2.1 time: 0.257772 Dec 15 14:18:49.945858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 410/826] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:49 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:50.161846 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:50.162538 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:50.169320 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.169765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.171314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.171833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.304711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:50.312896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:50.314425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:50.315620 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e1caacd4-2c1b-4348-b6c4-7b6c77c04a96 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.157832 Dec 15 14:18:50.316223 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 417/827] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:50 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:50.537624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:50.538447 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:50.544714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.545251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.546086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.546523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.611052 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-518e33eb-4972-4322-a703-440ddb36f4bf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.077112 Dec 15 14:18:50.611652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 411/828] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:50 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:50.961124 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:50.961729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:50.968241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.972576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:50.972576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:50.972576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.105704 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:51.113916 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-163e50e5-4fbd-40db-baa3-2c6a01a0fec8 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1272 microversion: 2.1 time: 0.156522 Dec 15 14:18:51.114495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 418/829] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:50 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:51.333568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:51.334179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:51.341031 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.341600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.342912 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.343498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.476032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:51.485500 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:51.487039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:51.488244 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a0c6f89a-bb9e-46b2-a61b-1a7c9175403c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.158940 Dec 15 14:18:51.488811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 412/830] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:51 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:18:51.621907 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:51.622836 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:51.629009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.630607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.630607 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:51.630807 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:51.692734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-081b9212-d5ac-4cf6-8aaf-b37df5f0206c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.074352 Dec 15 14:18:51.693347 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 419/831] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:51 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:52.130354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:52.131064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:52.137376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.137819 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.138584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.140061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.272794 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:52.280194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d3080385-0905-4631-a330-34a83a0a51c5 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1272 microversion: 2.1 time: 0.153492 Dec 15 14:18:52.280761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 413/832] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:52 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:52.506831 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:52.507518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:52.514744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.515192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.515984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.516412 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.652037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:52.659904 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:52.661544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:52.662750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a48a10db-19cc-4995-8baf-8c95553fd609 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.160003 Dec 15 14:18:52.663323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 420/833] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:52 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:52.702676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:52.703572 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:52.715647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.715647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.715647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.715647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.785750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6297a704-d001-4160-8664-65c8eb7c4b38 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.086639 Dec 15 14:18:52.789022 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 414/834] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:52 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:52.962673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:52.963171 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:52.970637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.971187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:52.971999 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:52.972447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.053618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'services' on Instance uuid 25314db9-9fee-46eb-8a55-fa7aaa694630 {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:18:53.270748 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c7dc047b-97ba-421d-a4c7-51765ac2d28d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments/bc83b166-c832-4844-9a4a-d69fe07894df" status: 202 len: 0 microversion: 2.1 time: 0.311584 Dec 15 14:18:53.271274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 421/835] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:18:52 2021] DELETE /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments/bc83b166-c832-4844-9a4a-d69fe07894df => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:18:53.280675 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:53.281971 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:53.288936 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.289382 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.290206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.290641 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.297714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:53.298493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:53.304971 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.305554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.306465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.306951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.321657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dcaa738d-be1e-4709-98d8-decaead1f876 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Dec 15 14:18:53.322221 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 415/836] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:53 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:53.441872 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:53.449231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3dc0a6ce-52f7-4414-b919-68fed146739a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.156068 Dec 15 14:18:53.449793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 422/837] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:53 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:53.681274 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:53.681879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:53.688755 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.689205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.689978 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.690411 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.796927 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:53.797884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:53.804084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.804531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.805306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:53.805739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:53.825140 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:53.833642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:53.835248 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:53.836459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c56de6d8-c5bb-43f8-9a29-b5ab96df798a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1743 microversion: 2.20 time: 0.158926 Dec 15 14:18:53.837011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 416/838] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:53 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:53.878561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a577bece-5837-48ea-a923-6a30eedf1a1e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.085286 Dec 15 14:18:53.879201 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 423/839] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:53 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:54.333452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:54.334344 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:54.345106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.345106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.345106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.345106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.372750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b0fb2504-0dd3-42a1-8b7a-9521b0cd1ace tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Dec 15 14:18:54.373853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 417/840] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:54 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:54.467488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:54.468230 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:54.475695 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.480291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.480291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.480291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.612331 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:54.619712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-51b50125-f638-474e-a007-ae0ba4b0f57a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.156833 Dec 15 14:18:54.620322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 424/841] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:54 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:54.855089 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:54.855695 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:54.862230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.862620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.863391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.863823 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.889687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:54.890594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:54.896951 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.897401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.898180 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:54.898618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:54.969977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-da86be3b-470f-4283-a0e9-99e24405b8b4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.084214 Dec 15 14:18:54.970627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 425/842] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:54 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:54.994945 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:55.002626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:55.004216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:55.006259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d0e80e15-62df-4781-ba63-41ba28888c6f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1743 microversion: 2.20 time: 0.155199 Dec 15 14:18:55.006830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 418/843] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:54 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:18:55.388052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:55.388052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:55.393655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.394109 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.394875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.395306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.423781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3ccbb187-a865-4bb2-8289-110eb087d628 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043064 Dec 15 14:18:55.424365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 426/844] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:18:55 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:55.635401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:55.640173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:55.642667 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.643261 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.644109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.644560 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.786073 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:55.793418 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3c775bcc-5c06-414b-b8b3-45b00fac1f11 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.161698 Dec 15 14:18:55.793979 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 419/845] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:55 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:55.980993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:55.981899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:55.988706 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.989150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:55.989916 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:55.990346 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.025515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:56.026121 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:56.032625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.033069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.033829 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.034402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.052376 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d3dfa382-a4c8-442a-976b-ae7e70460967 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.075073 Dec 15 14:18:56.053031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 427/846] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:55 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:56.172143 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:56.180106 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:56.181739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:56.182967 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-482fa51c-ceb4-4f3f-ba9f-f703c696a8f2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.161418 Dec 15 14:18:56.183650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 420/847] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:56 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:18:56.795914 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:56.814190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:56.814190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.814190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.814190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.814563 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.814977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:56.814977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:56.822556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.823551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.824761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:56.825467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:56.850583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:18:56.985604 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:56.993745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e245b109-69d9-45f3-8df1-aabfec7ebea4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.186615 Dec 15 14:18:57.004542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 421/848] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:56 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:57.065921 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:57.066877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:57.080359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.080814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.081618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.082058 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.177289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-59891b00-7e03-44e7-9e5a-17701b815c2c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 204 len: 0 microversion: 2.1 time: 0.385944 Dec 15 14:18:57.179470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 428/849] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:18:56 2021] DELETE /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:18:57.191863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:57.193196 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:57.197724 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c5f581e3-885e-4645-9fd5-eaa24b87e7f2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.135335 Dec 15 14:18:57.198427 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 422/850] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:57 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:57.206314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:57.207007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.207138 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:57.207797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.209145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.210328 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.232181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.233339 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.234434 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.238194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.724721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:57.738363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:57.744751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-231f1e43-b515-4d0f-939e-67d0b1fb7936 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1513 microversion: 2.1 time: 0.561311 Dec 15 14:18:57.745346 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 429/851] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:57 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1513 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:18:57.761311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:57.763150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:57.765098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d95703bc-f63c-49ad-a9d6-2e9951ab5dfb tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.565481 Dec 15 14:18:57.765658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 423/852] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:57 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:57.780597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-a458b123-aea4-41a0-b2df-9196b784c5fe req-c7e05585-4bde-468e-b25d-31b74fb96dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "name": "network-vif-plugged", "status": "completed", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:57.782253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:57.782253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:57.789246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-a458b123-aea4-41a0-b2df-9196b784c5fe req-c7e05585-4bde-468e-b25d-31b74fb96dd6 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:57.789684 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-a458b123-aea4-41a0-b2df-9196b784c5fe req-c7e05585-4bde-468e-b25d-31b74fb96dd6 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:57.801091 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-a458b123-aea4-41a0-b2df-9196b784c5fe req-c7e05585-4bde-468e-b25d-31b74fb96dd6 service nova] Creating event network-vif-plugged:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:18:57.805340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-a458b123-aea4-41a0-b2df-9196b784c5fe req-c7e05585-4bde-468e-b25d-31b74fb96dd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 Dec 15 14:18:57.806496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 430/853] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:18:58.011982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:58.012721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:58.019595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.020325 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.021453 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.022109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.168881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:58.180137 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0c7080a9-5960-49da-807d-a33a1b62cca0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.171798 Dec 15 14:18:58.180974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 424/854] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:58 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:58.209495 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:58.210465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:58.217157 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.217882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.218819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.219407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.290565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5fc00bfa-ca71-4775-ab72-8283d760cf28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.084800 Dec 15 14:18:58.291564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 431/855] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:58 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:18:58.764615 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:58.765432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:58.775147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.775597 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.776417 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.776849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.784502 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:58.785541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:58.792715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.793439 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:58.794418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:58.795177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.008156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.033000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3e8435b7-908e-4f2d-84ea-bb3a50bb46d2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1513 microversion: 2.1 time: 0.274479 Dec 15 14:18:59.036304 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 425/856] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:58 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:59.040373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.048594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.056043 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.056043 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-af37f03d-5da4-4e41-9c20-30697427feed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.272584 Dec 15 14:18:59.056043 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 432/857] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:18:58 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:18:59.198169 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:18:59.198947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:59.207036 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.207475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.208299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.208726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.302655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:59.303474 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:18:59.309807 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.311558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.312393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.312849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.376630 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1a45ac91-d8bf-4e36-8c88-a92032708840 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.077510 Dec 15 14:18:59.379814 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 433/858] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:18:59 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:18:59.477226 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:18:59.485231 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4cf56e3d-e4d1-4665-bcee-f1a3e976984e tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.290875 Dec 15 14:18:59.485813 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 426/859] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:18:59 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:18:59.752479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-e34ccfa8-8166-48e0-9c11-7a946df8210c req-87dab559-b462-4a62-8d67-7dd0b1a57f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25314db9-9fee-46eb-8a55-fa7aaa694630", "name": "network-vif-deleted", "tag": "09266547-aec9-4ddd-b235-14a60e8aa3cb"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:18:59.754465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:18:59.754465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:18:59.767307 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-e34ccfa8-8166-48e0-9c11-7a946df8210c req-87dab559-b462-4a62-8d67-7dd0b1a57f28 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:18:59.769809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-e34ccfa8-8166-48e0-9c11-7a946df8210c req-87dab559-b462-4a62-8d67-7dd0b1a57f28 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:18:59.784426 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-e34ccfa8-8166-48e0-9c11-7a946df8210c req-87dab559-b462-4a62-8d67-7dd0b1a57f28 service nova] Creating event network-vif-deleted:09266547-aec9-4ddd-b235-14a60e8aa3cb for instance 25314db9-9fee-46eb-8a55-fa7aaa694630 on hv-cinder-81322 Dec 15 14:18:59.793396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-e34ccfa8-8166-48e0-9c11-7a946df8210c req-87dab559-b462-4a62-8d67-7dd0b1a57f28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046047 Dec 15 14:18:59.794688 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 434/860] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:18:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:00.050285 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:00.051940 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:00.058885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.059326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.060227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.060658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.075085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:00.075740 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:00.085692 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.090345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.090345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.090345 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.140656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.141377 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.142147 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'fault' on Instance uuid 25314db9-9fee-46eb-8a55-fa7aaa694630 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:19:00.211431 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:00.221668 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-988c7cf3-6c40-4491-911c-e0e68d9596c9 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 200 len: 1308 microversion: 2.1 time: 0.175058 Dec 15 14:19:00.223101 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 427/861] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:00 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:00.283735 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:00.291774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:00.293398 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:00.294549 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4d862d78-6c7e-4d27-a5b4-5f4116ff72b6 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.226686 Dec 15 14:19:00.305353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 435/862] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:00 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:00.387039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:00.388394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:00.395345 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.396032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.397064 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.397584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.472314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-95cb10ec-c7bb-4079-b701-6faee11238e3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 14 microversion: 2.1 time: 0.089117 Dec 15 14:19:00.472948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 428/863] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:00 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:19:00.502835 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:00.503728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:00.510441 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.510883 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.511662 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:00.512123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:00.663356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:00.672031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0f64fcad-ff22-4b92-a7bd-452fda37e6d7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.173301 Dec 15 14:19:00.681930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 436/864] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:00 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:01.239595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:01.240424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 25314db9-9fee-46eb-8a55-fa7aaa694630] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:01.250953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.251770 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.252851 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.253517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.269778 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Instance 25314db9-9fee-46eb-8a55-fa7aaa694630 could not be found. Dec 15 14:19:01.270472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 404 to user: Instance 25314db9-9fee-46eb-8a55-fa7aaa694630 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:01.271375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-165ad2fc-b614-4332-a9b8-c3096ea2d47b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630" status: 404 len: 111 microversion: 2.1 time: 0.036013 Dec 15 14:19:01.272032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 429/865] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:01 2021] GET /compute/v2.1/servers/25314db9-9fee-46eb-8a55-fa7aaa694630 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:19:01.315054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:01.315755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:01.322352 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.322870 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.323877 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.324401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.486140 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:01.487076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:01.495078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:01.508589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:01.510187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:01.511366 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-68142337-7c7c-4e97-aee2-5a23dc508855 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.202273 Dec 15 14:19:01.511955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 437/866] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:01 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:01.514312 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.515287 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.516039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.516656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.609749 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d7b946d7-790f-484c-8b9f-9ecb639e2373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 7546 microversion: 2.1 time: 0.130393 Dec 15 14:19:01.610448 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 430/867] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:01 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 7546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:01.689418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:01.690990 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:01.697191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.697931 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.698959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:01.700076 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:01.856085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:01.867908 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ef0448c5-0b7f-4d01-b389-0f8f8301c372 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.182479 Dec 15 14:19:01.868563 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 438/868] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:01 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:02.531876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:02.532874 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:02.541151 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.541601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.542410 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.542876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.595698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:02.596512 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:02.603029 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.603887 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.604820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.605364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.634179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:19:02.705296 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:02.710217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:02.711767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:02.712955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7aa6fa8b-76f3-4f57-b739-fbff938d3ea8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.186102 Dec 15 14:19:02.713511 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 431/869] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:02 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:02.718684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:02.719652 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:02.725556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.726056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.726843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.727286 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.810785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8a0c102b-cf71-4ea6-8014-4eb0377d05ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 15025 microversion: 2.1 time: 0.095838 Dec 15 14:19:02.811542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 432/870] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:02 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 15025 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:02.886206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:02.887006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:02.893857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.894350 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:02.895149 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:02.895580 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.045916 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.054166 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c4090b8a-1d58-49ad-9c30-d263c7afefdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.171865 Dec 15 14:19:03.057586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 433/871] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:02 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:03.103185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b0817694-d75e-4884-a1dd-cf01d6ed9e8a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 204 len: 0 microversion: 2.1 time: 0.511177 Dec 15 14:19:03.104275 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 439/872] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:19:02 2021] DELETE /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:03.117846 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:03.117846 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:03.130885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.131426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.132298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.132869 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.294391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.303741 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-33b39986-7903-4220-b3b6-e1b5e294183a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1512 microversion: 2.1 time: 0.193972 Dec 15 14:19:03.304900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 434/873] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:03 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:03.381038 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-bd54a64e-e506-4344-85c2-33af72b9c2c1 req-3a8b2105-ecf4-4b12-95b5-60430a562976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "name": "network-vif-plugged", "status": "completed", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:03.386137 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:03.386137 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:19:03.393739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-bd54a64e-e506-4344-85c2-33af72b9c2c1 req-3a8b2105-ecf4-4b12-95b5-60430a562976 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.394179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-bd54a64e-e506-4344-85c2-33af72b9c2c1 req-3a8b2105-ecf4-4b12-95b5-60430a562976 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.405830 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-bd54a64e-e506-4344-85c2-33af72b9c2c1 req-3a8b2105-ecf4-4b12-95b5-60430a562976 service nova] Creating event network-vif-plugged:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:19:03.411431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-bd54a64e-e506-4344-85c2-33af72b9c2c1 req-3a8b2105-ecf4-4b12-95b5-60430a562976 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Dec 15 14:19:03.412061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 440/874] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:03.744863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:03.746324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:03.754814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.755644 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.756693 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.757398 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.824418 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:03.826632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:03.836849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.837597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.838576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:03.839178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:03.929666 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.941976 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.943565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:03.944783 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c9b36088-cb10-4437-9d4a-75ff6b1b00ad tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.204454 Dec 15 14:19:03.945344 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 435/875] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:03 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:04.073333 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:04.074073 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:04.081954 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.082657 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.083751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.084283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.115636 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-631ef26c-246f-475a-ba83-1b3a51134b04 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 17861 microversion: 2.1 time: 0.295455 Dec 15 14:19:04.122544 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 441/876] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:03 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 17861 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:04.244117 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:04.254661 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-883994cf-bfb7-4463-920f-538110365195 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.186734 Dec 15 14:19:04.255435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 436/877] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:04 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:04.321992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:04.322690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:04.330691 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.333679 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.334734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.335187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.490774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:04.498728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-928ecf83-94dd-4069-b496-6c2caa7f3d47 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1512 microversion: 2.1 time: 0.180490 Dec 15 14:19:04.499307 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 442/878] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:04 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:04.962579 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:04.965877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:04.970962 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.971413 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:04.972232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:04.972670 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.126654 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.133416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:05.135136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:05.143205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.144792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.145965 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-22706db5-700b-4260-aeb9-8d495908f775 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.187216 Dec 15 14:19:05.146524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 437/879] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:04 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:05.150804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.151254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.152284 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.152714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.254622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3687afde-2c96-4a68-8ce6-1faffb1d1794 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 19342 microversion: 2.1 time: 0.130430 Dec 15 14:19:05.255456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 443/880] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:05 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 19342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:05.272602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:05.273234 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:05.281530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.282194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.283181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.283779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.502449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.519894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b1d08b81-3c8c-4130-bbf4-6d0a413ac65f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1260 microversion: 2.1 time: 0.248437 Dec 15 14:19:05.520150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:05.520150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:05.530564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 438/881] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:05 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:05.531837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.532313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.533108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.533538 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.565738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-369072057"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:05.566426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:05.575299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.577855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.578822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:05.580741 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:05.900627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:05.909746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5372c88b-e1db-43ad-8714-4f5ca622cb2a tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1512 microversion: 2.1 time: 0.397481 Dec 15 14:19:05.910319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 444/882] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:05 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:05.931769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.network.security_group_api [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Removing security group e3a6788a-4487-4c74-bd81-0bd2c008548d from port 7f77f8ec-a564-45e4-a011-24904a851e4c Dec 15 14:19:06.165019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:06.165669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:06.172423 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.172867 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.173646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.174074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.588860 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3de6a3ed-6550-411a-bf95-c887fd046a1f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action" status: 202 len: 0 microversion: 2.1 time: 1.027675 Dec 15 14:19:06.589792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 439/883] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:05 2021] POST /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:19:06.598585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:06.601013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:06.616697 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.620359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.620359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.620359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.713702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:06.727198 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:06.729633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:06.731327 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-43916a1c-f128-444e-8741-749537996ea4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.569795 Dec 15 14:19:06.742259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 445/884] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:06 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:06.750901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c96a9915-8974-4327-a5cc-945b6db300a3 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 22217 microversion: 2.1 time: 0.155464 Dec 15 14:19:06.750901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 440/885] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:06 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 22217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:06.751800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:06.754390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}, {"server_uuid": "2c3ea596-c41d-460f-b7d1-95a563510fc8", "name": "network-vif-deleted", "tag": "17f63216-6143-430c-bb51-161f509fb578"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:06.757140 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:06.759156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:06.759156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:19:06.769711 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.770334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.770947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.771402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.782709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.784947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.834681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] Creating event network-changed:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:19:06.835568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] Creating event network-vif-deleted:17f63216-6143-430c-bb51-161f509fb578 for instance 2c3ea596-c41d-460f-b7d1-95a563510fc8 on hv-cinder-81322 Dec 15 14:19:06.857893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-73b338ca-de21-44e9-ba68-b56223a1453d req-6aa65f1d-203d-4b9d-88a1-05b0058908a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106173 Dec 15 14:19:06.864834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 441/886] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:06 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:06.937195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:06.937956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:06.950164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.950536 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:06.956099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:06.956099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.139882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:07.166766 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-59abbeea-13b0-465d-8968-7186a104fe1c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 200 len: 1302 microversion: 2.1 time: 0.237956 Dec 15 14:19:07.170931 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 442/887] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:06 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:07.328996 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:07.341746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-aae496e8-2871-4067-a867-e3ac739d0bec tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1444 microversion: 2.1 time: 0.598243 Dec 15 14:19:07.345001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 446/888] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:06 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1444 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:07.366445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:07.368839 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:07.399077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.399822 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.401261 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.403537 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.645229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:07.661271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d984b2f4-b400-4a96-bbb0-2f77ba428375 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1444 microversion: 2.1 time: 0.303177 Dec 15 14:19:07.672684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 443/889] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:07 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1444 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:07.750936 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:07.759160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:07.760387 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:07.762535 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:07.769612 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.770274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.770995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.771482 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.783154 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.783525 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.784359 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:07.784797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:07.875251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-34694f91-9db7-4220-bd28-477ea53e8d3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 23235 microversion: 2.1 time: 0.120282 Dec 15 14:19:07.877232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 444/890] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:07 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 23235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:08.025241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:08.049240 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:08.056634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:08.058162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ffbfb321-f31f-47b3-8c3b-46cb2730bc23 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1738 microversion: 2.20 time: 0.311952 Dec 15 14:19:08.059413 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 447/891] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:07 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:08.188974 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.190107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 2c3ea596-c41d-460f-b7d1-95a563510fc8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.197527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.198115 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.199035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.199591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.218792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Instance 2c3ea596-c41d-460f-b7d1-95a563510fc8 could not be found. Dec 15 14:19:08.219658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 404 to user: Instance 2c3ea596-c41d-460f-b7d1-95a563510fc8 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:08.220942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-aa1152e4-3cf8-4c09-be3d-f340552a5ea1 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8" status: 404 len: 111 microversion: 2.1 time: 0.037652 Dec 15 14:19:08.221724 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 445/892] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:08 2021] GET /compute/v2.1/servers/2c3ea596-c41d-460f-b7d1-95a563510fc8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:19:08.230349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.231126 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.238359 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.238908 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.240463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.240463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.274796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:19:08.289743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.290557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.300659 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.301379 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.302336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.302958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.390457 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lazy-loading 'services' on Instance uuid f84c8a7c-970e-4b20-8751-3e5346d209ea {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:19:08.593136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0f3d3ade-9497-4b2e-b011-23caa3ffae9d tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 204 len: 0 microversion: 2.1 time: 0.366663 Dec 15 14:19:08.597848 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 448/893] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:19:08 2021] DELETE /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:08.624964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a8d1164f-2276-40d8-8bc3-4e34ba024a18 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments/42b787fb-6e5f-4fe3-a432-4d7080703c06" status: 202 len: 0 microversion: 2.1 time: 0.339142 Dec 15 14:19:08.625564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 446/894] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:19:08 2021] DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments/42b787fb-6e5f-4fe3-a432-4d7080703c06 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:19:08.634799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.635515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.642541 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.643043 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.643953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.644650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.673145 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-1619e139-2d34-4594-9c94-8f90193c2b46 req-3d68a670-8e61-48bc-aa6c-e010b2f61799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:08.675253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:08.675253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:19:08.685488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-1619e139-2d34-4594-9c94-8f90193c2b46 req-3d68a670-8e61-48bc-aa6c-e010b2f61799 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.686217 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-1619e139-2d34-4594-9c94-8f90193c2b46 req-3d68a670-8e61-48bc-aa6c-e010b2f61799 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.697685 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-1619e139-2d34-4594-9c94-8f90193c2b46 req-3d68a670-8e61-48bc-aa6c-e010b2f61799 service nova] Creating event network-changed:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:19:08.703077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-1619e139-2d34-4594-9c94-8f90193c2b46 req-3d68a670-8e61-48bc-aa6c-e010b2f61799 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103705 Dec 15 14:19:08.703814 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 449/895] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:08.711754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:08.713012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.720088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.722715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.723764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.724225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.761206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ff9edd1b-5f18-4d67-8551-c6ce33fb8495 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053474 Dec 15 14:19:08.761963 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 450/896] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:19:08 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:08.888073 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:08.889570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:08.895669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.896167 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.896959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:08.897395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:08.991415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:08.994146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-786f0ced-3b29-4267-b0a5-5aa8bf6c73ab tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 24805 microversion: 2.1 time: 0.109848 Dec 15 14:19:08.995025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 451/897] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:08 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 24805 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:09.001680 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bab03bff-b3be-448f-bea7-17036c0cffea tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1514 microversion: 2.1 time: 0.374944 Dec 15 14:19:09.002260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 447/898] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:08 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:09.080797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:09.081610 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:09.090024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.094434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.094434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.094434 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.733948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:09.742581 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:09.744308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:09.745613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-86924767-03c2-401d-a5af-6ce8027cff1e tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1720 microversion: 2.20 time: 0.672121 Dec 15 14:19:09.746541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 452/899] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:09 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1720 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:09.773676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:09.774664 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:09.781206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.781688 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.782472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:09.782908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:09.814714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-38726a9f-9b3d-405a-8251-f2e73f78bc68 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Dec 15 14:19:09.815533 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 448/900] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:19:09 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:19:10.008490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:10.009518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.016866 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.017409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.018274 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.018777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.019061 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:10.019694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.025782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.029855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.029855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.029855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.119116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ff1727b0-494b-498a-a7a4-cfde3d6ccb08 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 26025 microversion: 2.1 time: 0.115112 Dec 15 14:19:10.120061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 453/901] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:10 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 26025 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:10.447769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:10.457283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-cf9869e7-72c5-4fed-9670-fc8e88521d17 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1514 microversion: 2.1 time: 0.441930 Dec 15 14:19:10.469066 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 449/902] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:10 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1514 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:10.765748 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:10.767457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.776288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.776745 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.777551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.777989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.826421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:10.827808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.835398 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.836138 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.837252 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.837853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.875893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c8435537-7f46-4e22-8c14-49b07fd8217a tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053413 Dec 15 14:19:10.876792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 450/903] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:19:10 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:19:10.886773 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:10.887782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:10.895532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.896624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.897908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:10.898518 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:10.994866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] HTTP exception thrown: Instance f84c8a7c-970e-4b20-8751-3e5346d209ea is not attached to volume 42b787fb-6e5f-4fe3-a432-4d7080703c06 Dec 15 14:19:10.995669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Returning 404 to user: Instance f84c8a7c-970e-4b20-8751-3e5346d209ea is not attached to volume 42b787fb-6e5f-4fe3-a432-4d7080703c06 {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:10.996795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f289c3f0-3040-444e-9c63-6685a14288c2 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments/42b787fb-6e5f-4fe3-a432-4d7080703c06" status: 404 len: 154 microversion: 2.1 time: 0.114101 Dec 15 14:19:10.998565 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 451/904] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:19:10 2021] DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea/os-volume_attachments/42b787fb-6e5f-4fe3-a432-4d7080703c06 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:19:11.003454 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-3ac8d6ac-9095-4a4f-8a3b-b59f41aa456a req-0055aa7b-9e7e-4018-9548-72a546304836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbf4fc8-88c2-4070-a5ff-5e5845affa90", "name": "network-vif-deleted", "tag": "4732b8b2-cc35-4586-a6eb-d32aa6c61027"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:11.005172 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:11.005172 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:19:11.012779 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-3ac8d6ac-9095-4a4f-8a3b-b59f41aa456a req-0055aa7b-9e7e-4018-9548-72a546304836 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.013369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-3ac8d6ac-9095-4a4f-8a3b-b59f41aa456a req-0055aa7b-9e7e-4018-9548-72a546304836 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.025383 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-3ac8d6ac-9095-4a4f-8a3b-b59f41aa456a req-0055aa7b-9e7e-4018-9548-72a546304836 service nova] Creating event network-vif-deleted:4732b8b2-cc35-4586-a6eb-d32aa6c61027 for instance 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 on hv-cinder-81322 Dec 15 14:19:11.030769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-3ac8d6ac-9095-4a4f-8a3b-b59f41aa456a req-0055aa7b-9e7e-4018-9548-72a546304836 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030750 Dec 15 14:19:11.031369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 452/905] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:11.077983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:11.085973 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:11.087519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:11.088721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-72c4e98b-8f5e-44da-ad4f-aa4142156a7c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1720 microversion: 2.20 time: 0.327491 Dec 15 14:19:11.099655 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 454/906] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:10 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1720 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:11.132868 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:11.133901 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:11.144076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.144566 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.145360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.145789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.227424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7c9a2a16-e30e-4f64-bcfe-58e2f80b3b51 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 26972 microversion: 2.1 time: 0.100007 Dec 15 14:19:11.228898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 453/907] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:11 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 26972 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:11.257116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-6ed21c58-672f-48cd-bcb7-227854cace3d req-19654e9f-65d4-446a-9d0a-15058593158b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:11.258679 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:11.258679 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:19:11.267163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-6ed21c58-672f-48cd-bcb7-227854cace3d req-19654e9f-65d4-446a-9d0a-15058593158b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.267624 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-6ed21c58-672f-48cd-bcb7-227854cace3d req-19654e9f-65d4-446a-9d0a-15058593158b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.282707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-6ed21c58-672f-48cd-bcb7-227854cace3d req-19654e9f-65d4-446a-9d0a-15058593158b service nova] Creating event network-changed:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:19:11.288828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-6ed21c58-672f-48cd-bcb7-227854cace3d req-19654e9f-65d4-446a-9d0a-15058593158b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035339 Dec 15 14:19:11.289639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 455/908] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:11.475356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:11.476152 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:11.484617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.485069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.485881 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.486318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.521938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:11.522306 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:11.522758 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'fault' on Instance uuid 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:19:11.570001 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:11.578713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fdd36d99-a99f-47c3-a544-31f32a0ca23b tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 200 len: 1308 microversion: 2.1 time: 0.107395 Dec 15 14:19:11.583537 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 454/909] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:11 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:12.107673 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:12.108391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:12.115219 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.116284 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.117304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.117783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.239351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:12.242858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:12.251527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.251656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.252419 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.253033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.278589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:12.287477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:12.289047 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:12.290248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e0c073d5-fc49-469e-b7cf-ba60d7a92b29 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1720 microversion: 2.20 time: 0.187345 Dec 15 14:19:12.290962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 456/910] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:12 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:12.296705 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:12.297199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:12.303125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.303572 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.304380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.304843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.331125 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:19:12.335086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8d7778ef-5a0f-4407-96d3-179e9554a6fb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 27633 microversion: 2.1 time: 0.100017 Dec 15 14:19:12.335753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 455/911] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:12 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 27633 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:12.597003 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:12.597756 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 0fbf4fc8-88c2-4070-a5ff-5e5845affa90] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:12.600009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2be4be01-ac30-49e7-a95d-42776f20413d tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 204 len: 0 microversion: 2.1 time: 0.306803 Dec 15 14:19:12.600803 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 457/912] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:19:12 2021] DELETE /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:12.605012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.608108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.608108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.608108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.615026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:12.615730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:12.621112 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Instance 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 could not be found. Dec 15 14:19:12.621527 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.621710 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 404 to user: Instance 0fbf4fc8-88c2-4070-a5ff-5e5845affa90 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:12.621981 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.622551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3971eb6a-6574-44bd-b0dd-e5330fa73890 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90" status: 404 len: 111 microversion: 2.1 time: 0.029682 Dec 15 14:19:12.622785 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:12.623227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:12.623327 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 456/913] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:12 2021] GET /compute/v2.1/servers/0fbf4fc8-88c2-4070-a5ff-5e5845affa90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:19:12.764401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:12.771863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-561490ab-6b84-40f3-9fe6-3147bc51c8bb tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1552 microversion: 2.1 time: 0.160990 Dec 15 14:19:12.772536 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 458/914] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:12 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:13.206534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-dd56d237-39b8-4ce8-b2de-043373c4ca88 req-070a2ee2-55b6-4c00-b27d-a663f0ae662d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:13.208119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:13.208119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:19:13.219948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-dd56d237-39b8-4ce8-b2de-043373c4ca88 req-070a2ee2-55b6-4c00-b27d-a663f0ae662d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.220408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-dd56d237-39b8-4ce8-b2de-043373c4ca88 req-070a2ee2-55b6-4c00-b27d-a663f0ae662d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.231891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-dd56d237-39b8-4ce8-b2de-043373c4ca88 req-070a2ee2-55b6-4c00-b27d-a663f0ae662d service nova] Creating event network-vif-unplugged:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:19:13.236802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-dd56d237-39b8-4ce8-b2de-043373c4ca88 req-070a2ee2-55b6-4c00-b27d-a663f0ae662d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033930 Dec 15 14:19:13.237396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 457/915] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:19:13.309089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:13.314231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.317245 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.317820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.318856 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.319393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.348599 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:13.349600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.360859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.361441 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.362463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.363092 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.469034 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9bce62c2-bf47-4c13-8739-5be685b0862c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 28002 microversion: 2.1 time: 0.125485 Dec 15 14:19:13.472862 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 458/916] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:13 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 28002 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:13.474120 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:13.482804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:13.484470 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:13.485631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1d1d92ab-f75f-446a-a2ae-a38a3af3a989 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1663 microversion: 2.20 time: 0.180584 Dec 15 14:19:13.486200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 459/917] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:13 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:13.503671 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32814f26-919e-4309-911e-3c809a30cc4f"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:13.504859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.511711 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.512185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.512959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.514159 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.789797 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:13.790406 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.796955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.797406 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.798181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.798618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.928057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:13.935903 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6b2fba20-5973-4aa5-a525-8c4d12422d3e tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1552 microversion: 2.1 time: 0.149825 Dec 15 14:19:13.936498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 460/918] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:13 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:13.940839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:13.941334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:13.946864 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.950111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.950111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:13.950111 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:13.973864 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:19:14.331487 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-dfedd184-e833-4655-a8bd-9077139aebc2 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 204 len: 0 microversion: 2.1 time: 0.393696 Dec 15 14:19:14.332211 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 461/919] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:19:13 2021] DELETE /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:14.340116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:14.340811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:14.346940 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.347386 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.348199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.348627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.485790 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:14.493100 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5efe0a7a-369f-4bee-bf9c-a5b5496df59c tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1512 microversion: 2.1 time: 0.156883 Dec 15 14:19:14.493671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 462/920] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:14 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:14.499094 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:14.500127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:14.505944 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.511530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.511530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.511530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.552900 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2f3da617-6ef2-4079-9113-e0bd1e0031c4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.053439 Dec 15 14:19:14.553663 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 459/921] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Dec 15 14:19:13 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:14.611732 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9a139892-66a4-4a18-b055-24e835999ae4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 28245 microversion: 2.1 time: 0.116840 Dec 15 14:19:14.612605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 463/922] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:14 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 28245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:14.663767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:14.664290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:14.672173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.672627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.673397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.673824 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.952877 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:14.953597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:14.960481 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.960927 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:14.961783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:14.962252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.112526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.119861 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7fc8f031-7d01-41bf-bbd2-e2dfa4eb59fd tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1552 microversion: 2.1 time: 0.171124 Dec 15 14:19:15.120456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 464/923] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:14 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:15.245425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-4bf6dbad-8485-42e9-aff8-e5cbd2823116 req-a6c9efd2-ff02-4c18-b812-7660c77ae339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84c8a7c-970e-4b20-8751-3e5346d209ea", "name": "network-vif-deleted", "tag": "7f77f8ec-a564-45e4-a011-24904a851e4c"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:15.246958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:15.246958 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:19:15.254015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4bf6dbad-8485-42e9-aff8-e5cbd2823116 req-a6c9efd2-ff02-4c18-b812-7660c77ae339 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.254462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-4bf6dbad-8485-42e9-aff8-e5cbd2823116 req-a6c9efd2-ff02-4c18-b812-7660c77ae339 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.267991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-4bf6dbad-8485-42e9-aff8-e5cbd2823116 req-a6c9efd2-ff02-4c18-b812-7660c77ae339 service nova] Creating event network-vif-deleted:7f77f8ec-a564-45e4-a011-24904a851e4c for instance f84c8a7c-970e-4b20-8751-3e5346d209ea on hv-cinder-81322 Dec 15 14:19:15.272899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-4bf6dbad-8485-42e9-aff8-e5cbd2823116 req-a6c9efd2-ff02-4c18-b812-7660c77ae339 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Dec 15 14:19:15.273491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 465/924] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:19:15.276077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6b89e7a2-61f8-4597-a711-7b234e2debf4 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments/32814f26-919e-4309-911e-3c809a30cc4f" status: 202 len: 0 microversion: 2.20 time: 0.615752 Dec 15 14:19:15.276814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 460/925] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Dec 15 14:19:14 2021] DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments/32814f26-919e-4309-911e-3c809a30cc4f => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:15.336421 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:15.337161 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:15.344003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.344453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.345233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.345671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.513107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:15.514877 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:15.521158 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.521603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.522386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.522854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.590713 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-31c5f871-6911-471e-b36f-e4ae1f854ac8 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action" status: 202 len: 0 microversion: 2.20 time: 0.258454 Dec 15 14:19:15.595551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 466/926] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 14:19:15 2021] POST /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:19:15.611671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:15.612547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:15.620146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.620708 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.621576 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.622093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.699214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.710516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-36c9ca49-74f2-431c-8374-79095ba152bf tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1512 microversion: 2.1 time: 0.202117 Dec 15 14:19:15.711549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 461/927] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:15 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:15.717315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:15.718290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:15.726042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.726559 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.727782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:15.728395 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:15.787351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.793177 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2c910b3e-d68a-4619-9334-a9ab79f58361 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 28245 microversion: 2.1 time: 0.080129 Dec 15 14:19:15.794874 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 462/928] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:15 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 28245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:15.796540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.798099 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:15.799260 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c24c1b63-603b-4e4b-85d0-86ccca19778c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1671 microversion: 2.20 time: 0.198219 Dec 15 14:19:15.799799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 467/929] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:15 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:16.137625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:16.138915 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:16.145527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.145975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.146761 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.147201 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.178346 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.178808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.179251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lazy-loading 'fault' on Instance uuid f84c8a7c-970e-4b20-8751-3e5346d209ea {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:19:16.219217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b150c32b905548ed83d3326596f88c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed188fb44624c1b86723b0a0cf261c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.226759 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-543fb758-d672-4c58-b1b5-6314eb49885f tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 200 len: 1346 microversion: 2.1 time: 0.093217 Dec 15 14:19:16.227322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 463/930] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:16 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:16.729193 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:16.733030 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:16.740965 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.742410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.742410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.742410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.805747 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:16.806763 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:16.814814 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.815516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.826233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.826233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.826587 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.829317 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d5de3dde-89fd-4ed1-8837-e174f9e2bfd5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1470 microversion: 2.1 time: 0.105054 Dec 15 14:19:16.830221 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 468/931] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:16 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:16.835408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:16.836027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:16.842444 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.842929 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.843729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:16.844244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:16.906016 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-84c8a8ad-ee06-442e-818d-cfb0493d1e33 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 28536 microversion: 2.1 time: 0.103716 Dec 15 14:19:16.909928 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 464/932] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:16 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 28536 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:16.979062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.987053 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.988643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:16.989802 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f0b69b83-87a3-4060-8cbb-4f666a8508ac tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1673 microversion: 2.20 time: 0.158528 Dec 15 14:19:16.990827 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 469/933] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:16 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:17.247009 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:17.248283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] [instance: f84c8a7c-970e-4b20-8751-3e5346d209ea] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:17.255041 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.255490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.256296 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.256735 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.270426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] HTTP exception thrown: Instance f84c8a7c-970e-4b20-8751-3e5346d209ea could not be found. Dec 15 14:19:17.271011 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Returning 404 to user: Instance f84c8a7c-970e-4b20-8751-3e5346d209ea could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:17.271821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2f4fda1a-72e4-4914-bd1c-b0aff7844201 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea" status: 404 len: 111 microversion: 2.1 time: 0.028995 Dec 15 14:19:17.272375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 465/934] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:17 2021] GET /compute/v2.1/servers/f84c8a7c-970e-4b20-8751-3e5346d209ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:19:17.280690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-de1a9f31-98d0-46b7-afd8-142b2f2484c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] Calling method '.version_select at 0x7f9cbeac9c10>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:17.288491 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-0eafa302-4d48-4af0-a290-6d01856ca6ec req-bebb6264-abbf-4c3b-b684-47e109b3a460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6facd328-628c-4075-b7e0-685acaf6112d", "name": "network-vif-deleted", "tag": "8d57ebc8-df52-4c7e-a667-d3e62ecd8753"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:17.290076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:17.290076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:19:17.298130 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-0eafa302-4d48-4af0-a290-6d01856ca6ec req-bebb6264-abbf-4c3b-b684-47e109b3a460 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.298577 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-0eafa302-4d48-4af0-a290-6d01856ca6ec req-bebb6264-abbf-4c3b-b684-47e109b3a460 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.310775 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-0eafa302-4d48-4af0-a290-6d01856ca6ec req-bebb6264-abbf-4c3b-b684-47e109b3a460 service nova] Creating event network-vif-deleted:8d57ebc8-df52-4c7e-a667-d3e62ecd8753 for instance 6facd328-628c-4075-b7e0-685acaf6112d on hv-cinder-81322 Dec 15 14:19:17.315679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-0eafa302-4d48-4af0-a290-6d01856ca6ec req-bebb6264-abbf-4c3b-b684-47e109b3a460 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Dec 15 14:19:17.316375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 466/935] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:17.389819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-de1a9f31-98d0-46b7-afd8-142b2f2484c5 tempest-TestMinimumBasicScenario-1338387497 tempest-TestMinimumBasicScenario-1338387497-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-549090501" status: 202 len: 0 microversion: 2.1 time: 0.112517 Dec 15 14:19:17.390568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 470/936] 10.222.0.36 () {58 vars in 1268 bytes} [Wed Dec 15 14:19:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-549090501 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:19:17.847582 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:17.848330 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:17.854965 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.855412 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.856227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.856732 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.891611 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.892114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.892750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lazy-loading 'fault' on Instance uuid 6facd328-628c-4075-b7e0-685acaf6112d {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:19:17.920813 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:17.921953 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:17.933300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.933976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.945058 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:17.945516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:17.958704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e8dd95f1734cf496ebf2addbe7cb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb03627f3cf48e883d03edd35399116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:17.966354 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0ddb6fad-a4ea-4d00-8a18-7da3902ffa85 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 200 len: 1307 microversion: 2.1 time: 0.123379 Dec 15 14:19:17.967107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 467/937] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:17 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:18.010710 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:18.011321 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:18.017376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.021045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:18.021045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.021045 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:18.032552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4322400b-4c7a-4e3b-9b0e-e9a0005e2b9d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 28704 microversion: 2.1 time: 0.118171 Dec 15 14:19:18.033281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 471/938] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:17 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 28704 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:18.257642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:18.265788 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:18.267333 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:18.268593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c95c3574-7a4f-43a8-bc46-f89eeac32aaf tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.261895 Dec 15 14:19:18.269163 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 468/939] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:18 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:18.986622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:18.987229 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] [instance: 6facd328-628c-4075-b7e0-685acaf6112d] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:18.995901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.996723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:18.997730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:18.998952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.013923 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] HTTP exception thrown: Instance 6facd328-628c-4075-b7e0-685acaf6112d could not be found. Dec 15 14:19:19.014881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] Returning 404 to user: Instance 6facd328-628c-4075-b7e0-685acaf6112d could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:19:19.015795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9d050d04-ffce-4520-b9a3-d8a8e4867ff5 tempest-AttachVolumeNegativeTest-1238027083 tempest-AttachVolumeNegativeTest-1238027083-project] 10.222.0.36 "GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d" status: 404 len: 111 microversion: 2.1 time: 0.035331 Dec 15 14:19:19.016452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 472/940] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:18 2021] GET /compute/v2.1/servers/6facd328-628c-4075-b7e0-685acaf6112d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:19:19.045864 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:19.049036 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:19.056488 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:19.057153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.058170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:19.058785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.292335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:19.295604 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:19.306910 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:19.307479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.308621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:19.309113 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:19.915851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:19.926179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:19.928050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:19.929458 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e7a4d085-899e-4ff0-8e2a-f6ef37cdc2d5 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.646828 Dec 15 14:19:19.930562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 473/941] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:19 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:20.952771 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:20.954337 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:20.961460 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:20.961987 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:20.968250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:20.968250 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:21.239153 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:21.247490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:21.249556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:21.251273 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e92ec777-1139-4da0-8bf4-c2c7f03b2b8a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.305376 Dec 15 14:19:21.253306 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 474/942] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:20 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:22.274311 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:22.275010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:22.285621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:22.286462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:22.287492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:22.288193 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:22.516766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:22.524811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:22.526347 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:22.527581 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc0cb9c7-5610-433b-b5a3-27e87b57a353 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.257837 Dec 15 14:19:22.528163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 475/943] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:22 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:23.548456 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:23.549150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:23.556892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:23.557545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:23.558631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:23.559261 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:23.761633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:23.771912 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:23.778622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:23.780390 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a253bac7-ca3c-4000-940e-8df89e1d6559 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.237216 Dec 15 14:19:23.787149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 476/944] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:23 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:24.802069 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:24.804117 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:24.814852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:24.815636 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:24.817078 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:24.817520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:25.042168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:25.058570 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:25.061230 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:25.072809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4805b6eb-1f89-434d-a55a-b0ca6dd07eb7 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.266561 Dec 15 14:19:25.072809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 477/945] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:24 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:26.084106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:26.086073 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:26.097375 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:26.100079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:26.111693 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:26.112233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:26.336658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:26.346121 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:26.348323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:26.349806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a53adc92-eec4-48f7-94d1-79a682722c82 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.270997 Dec 15 14:19:26.350927 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 478/946] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:26 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:27.368861 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:27.370546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:27.377924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:27.378897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:27.379880 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:27.380498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:27.605863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:27.616092 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:27.618126 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:27.619264 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-fc4562aa-d7ed-4f0b-932c-33fd7a9216e0 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.254796 Dec 15 14:19:27.619893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 479/947] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:27 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:28.639128 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:28.639769 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:28.650185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:28.650724 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:28.651546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:28.651997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:28.805415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:28.823755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:28.823755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:28.823755 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0f7ac5c6-5f28-4da3-b2fc-c499ff53ea6b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.188503 Dec 15 14:19:28.824242 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 480/948] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:28 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:29.840060 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:29.840753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:29.852077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:29.852077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:29.852077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:29.852077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:29.987531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:29.995417 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:29.996986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:29.998945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0c18cfa9-44f8-4493-9f7e-64fb6b58727a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.162730 Dec 15 14:19:29.999500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 481/949] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:29 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:31.018103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:31.018790 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:31.024966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:31.025416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:31.026191 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:31.026627 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:31.161550 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:31.169656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:31.171215 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:31.172465 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-956627aa-cfdd-442e-a7eb-3dd9c3d2f8ed tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.158127 Dec 15 14:19:31.173025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 482/950] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:31 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:31.474534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8ee8724e-261e-4d6e-86d5-a3c3717520b2 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 33677 microversion: 2.1 time: 12.433722 Dec 15 14:19:31.475193 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 469/951] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:19 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 33677 bytes in 12435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:32.191044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:32.191650 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:32.197952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.198396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.199169 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.199601 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.328593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:32.336272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:32.337820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:32.338971 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ae8d6966-1d3e-4457-b4d8-a750aa866c30 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.151737 Dec 15 14:19:32.339527 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 483/952] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:32 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:32.487408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:32.488419 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:32.495744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.499219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.499219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:32.499219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:32.582852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-791f3e57-5dcc-4896-90b6-b392e0562373 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 34316 microversion: 2.1 time: 0.094446 Dec 15 14:19:32.582852 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 470/953] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:32 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 34316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:33.356918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:33.357686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:33.363729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.366252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.366252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.366252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.508358 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:33.517334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:33.519050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:33.520225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1953a472-a1b5-4456-bb4f-735981fdd964 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.167487 Dec 15 14:19:33.524035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 484/954] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:33 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:33.589690 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:33.590637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:33.597734 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.598182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.601415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:33.601415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:33.679046 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7d1a4d6f-d3c6-4681-aaef-815fa1bdd3bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 35326 microversion: 2.1 time: 0.093339 Dec 15 14:19:33.679968 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 471/955] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:33 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 35326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:34.538766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:34.539373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:34.546209 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.546646 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.547420 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.547852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.691845 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:34.692882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:34.697480 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:34.700746 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.701428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.702230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:34.702659 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:34.707519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:34.709177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:34.710350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-82280805-3541-4c79-bc29-4121de9f8034 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.175382 Dec 15 14:19:34.711106 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 485/956] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:34 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:34.780374 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9bd3dfb7-1b99-437a-8b00-d9f5989267bb tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 36610 microversion: 2.1 time: 0.092329 Dec 15 14:19:34.781068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 472/957] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:34 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 36610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:35.728890 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:35.729500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:35.737105 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.737547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.738321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.738784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.794493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:35.794493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:35.800614 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.801070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.801859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:35.802291 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:35.877556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:35.881656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0b911b25-7d7b-475b-8a81-b07a3a75195b tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 37863 microversion: 2.1 time: 0.093381 Dec 15 14:19:35.882584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 473/958] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:35 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 37863 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 14:19:35.885818 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:35.887399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:35.889765 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1ce86c4f-37ad-409f-9ab8-b9a8008202c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.163659 Dec 15 14:19:35.894163 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 486/959] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:35 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:36.894605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:36.897344 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:36.902571 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.903025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:36.903847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.904845 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:36.910941 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:36.911547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:36.918384 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.920268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:36.920268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:36.920268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:36.983101 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-968b8a92-73f0-4441-9b2b-e69f7ed00aaa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 38234 microversion: 2.1 time: 0.092373 Dec 15 14:19:36.983784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 474/960] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:36 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 38234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:37.057518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:37.066036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:37.068085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:37.072734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-97dc4365-4c11-4855-a436-5ffb9b22282b tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.162177 Dec 15 14:19:37.072734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 487/961] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:36 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:19:37.672305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-8fb2f7c7-5d2a-49a0-8ff8-65dcd556d1e9 req-f7c1fcb1-cb2f-4deb-b4ec-f0dec8f86e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "name": "network-vif-plugged", "status": "completed", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:37.675107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:19:37.675107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:19:37.684546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-8fb2f7c7-5d2a-49a0-8ff8-65dcd556d1e9 req-f7c1fcb1-cb2f-4deb-b4ec-f0dec8f86e62 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:37.685020 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-8fb2f7c7-5d2a-49a0-8ff8-65dcd556d1e9 req-f7c1fcb1-cb2f-4deb-b4ec-f0dec8f86e62 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:37.697600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-8fb2f7c7-5d2a-49a0-8ff8-65dcd556d1e9 req-f7c1fcb1-cb2f-4deb-b4ec-f0dec8f86e62 service nova] Creating event network-vif-plugged:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:19:37.702582 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-8fb2f7c7-5d2a-49a0-8ff8-65dcd556d1e9 req-f7c1fcb1-cb2f-4deb-b4ec-f0dec8f86e62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036031 Dec 15 14:19:37.703185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 475/962] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:37.994577 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:37.995488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:38.002093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.002545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.003339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.003775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.070476 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-37f21401-5d7a-494b-a55a-1485c70bbddf tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 38234 microversion: 2.1 time: 0.079461 Dec 15 14:19:38.071401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 488/963] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:37 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 38234 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:38.089614 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:38.099173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:38.099173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.099173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.099495 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:38.099784 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:38.238031 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:38.245753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:38.248320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:38.248926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fa3f8c45-8a6f-4840-afe9-e4f3071b0003 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.164055 Dec 15 14:19:38.249486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 476/964] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:38 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:39.082789 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:39.083844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:39.090728 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.091178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.092011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.092452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.175575 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d4222409-a8df-4308-a5ac-cb2146985820 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 38234 microversion: 2.1 time: 0.096753 Dec 15 14:19:39.179698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 489/965] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:39 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 38234 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:39.266645 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:39.270686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:39.273743 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.274195 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.274988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:39.275421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:39.421168 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:39.432031 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:39.433637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:39.435228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bbe2bbdc-6f4a-4b44-8a0a-fa54c207939d tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.172428 Dec 15 14:19:39.435722 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 477/966] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:39 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:40.188594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:40.189595 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:40.196841 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.197290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.198071 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.198509 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.269633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-501a3f11-b8d3-4247-af8f-61ad6af00764 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action" status: 200 len: 38363 microversion: 2.1 time: 0.085611 Dec 15 14:19:40.273247 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 490/967] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:19:40 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/action => generated 38363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 14:19:40.281848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:40.282340 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:40.288907 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.289399 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.290255 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.290691 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.314714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ce437aca-a208-480c-93a1-5bf2a2a31ab9 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/ips" status: 200 len: 144 microversion: 2.1 time: 0.036661 Dec 15 14:19:40.315297 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 478/968] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:19:40 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:40.454529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:40.455225 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:40.462341 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.462784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.463763 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:40.464219 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:40.600764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:40.609817 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:40.611402 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:40.612592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b6874f3a-47d9-4fc6-9034-f61ac842984a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1729 microversion: 2.20 time: 0.162737 Dec 15 14:19:40.613185 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 491/969] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:40 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:41.630792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:41.631396 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:41.637591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.638216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:41.639029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.639461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:41.777372 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:41.785983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:41.787519 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:41.788696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-61df8068-3c47-4f3d-838e-16712457578c tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1716 microversion: 2.20 time: 0.161969 Dec 15 14:19:41.789250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 479/970] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:19:41 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:19:41.915772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42951628-c8e9-4a5c-b0c6-93ab934f6efb"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:41.916858 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:41.923911 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.924500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:41.925316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:41.925594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:42.645064 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-569bfd74-6aa5-4f0b-9c4d-f6f70e012b28 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732496 Dec 15 14:19:42.645676 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 492/971] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:19:41 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:50.121057 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:50.121958 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:50.128811 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:50.129256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:50.130028 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:50.130455 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:50.160545 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d3b3f4cb-726a-4e44-b302-42222d704b4f tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043165 Dec 15 14:19:50.161113 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 480/972] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:19:50 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:50.172109 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:50.172849 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:50.179809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:50.180302 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:50.181088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:50.181522 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:50.213148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f22df751-9570-4bf2-9bb7-62cf4d5e0b57 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb" status: 200 len: 194 microversion: 2.1 time: 0.045866 Dec 15 14:19:50.214004 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 493/973] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 14:19:50 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:19:51.847800 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97ebd048-4ca9-40b2-8e62-011c45600784"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:51.848850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:51.855283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:51.855953 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:51.856731 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:51.857216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:52.661802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-463f9528-6bd0-49e8-b522-aa78b6bf44ce tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817592 Dec 15 14:19:52.662415 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 481/974] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 14:19:51 2021] POST /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:19:56.207336 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-428305578", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "bb4e1880-84ea-4fab-ae20-ce3f398a76b0"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:19:56.259643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] validate_networks() for [('bb4e1880-84ea-4fab-ae20-ce3f398a76b0', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:19:56.601340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:19:56.601814 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:19:56.602290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:19:56.602698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:19:56.603357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:19:56.612681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:56.613108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:56.613909 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:56.614340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:56.630485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Getting quotas for project d84c55322ce848ae8db4d5528bc6d79f. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:19:56.634290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Getting quotas for user 024d5cf69a5047279754065c6f675475 and project d84c55322ce848ae8db4d5528bc6d79f. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:19:56.645534 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:19:56.647803 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:19:56.761960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cd3c4871-7d73-46c6-a5fd-ea2f72c554f1 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558430 Dec 15 14:19:56.762605 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 494/975] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:19:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:19:56.773512 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b7775d40-235d-4013-9f2f-3bafe804f04e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:56.774206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b7775d40-235d-4013-9f2f-3bafe804f04e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:56.832029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b7775d40-235d-4013-9f2f-3bafe804f04e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:56.838785 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b7775d40-235d-4013-9f2f-3bafe804f04e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1213 microversion: 2.1 time: 0.069822 Dec 15 14:19:56.839620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 482/976] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:56 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:19:57.858257 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:57.858792 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:57.864766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:57.865227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:57.866002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:57.866433 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:57.929363 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:57.937368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1f3e8e78-85a5-43ab-a316-4c1e64d4e4f5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1217 microversion: 2.1 time: 0.084168 Dec 15 14:19:57.942031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 495/977] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:57 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:19:58.954919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:19:58.955546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:19:58.962890 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:58.963333 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:58.964361 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:19:58.964568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:19:59.035124 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:19:59.042425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7af198da-3f6b-4e42-b07a-b592fbe8b0f2 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1265 microversion: 2.1 time: 0.091905 Dec 15 14:19:59.042999 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 483/978] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:19:58 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:00.060860 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:00.062089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:00.070176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.070898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.072175 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.072929 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.145526 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:00.146498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:00.152980 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.153432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.154263 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.154702 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.186184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0ceb4c1b-153d-49fa-9cac-f53fa551f743 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044388 Dec 15 14:20:00.193774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 484/979] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:20:00 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:00.220656 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:00.228396 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5d6b3aee-3b90-4925-9c95-8e3115ea1526 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.172484 Dec 15 14:20:00.229173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 496/980] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:00 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:00.475897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:00.476646 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:00.482676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.483150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.485078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.485516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.514222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-efeabfca-5ef0-4858-88ea-cccc6fbf8ab0 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb" status: 200 len: 194 microversion: 2.1 time: 0.042149 Dec 15 14:20:00.515451 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 485/981] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 14:20:00 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:00.524806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:00.525297 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:00.532292 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.532727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.533529 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.533959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.614025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lazy-loading 'services' on Instance uuid 0ad61711-58ee-4f49-8b73-a7879a8743ee {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:00.693941 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5b7e22f7-c237-4d89-b7d0-df0794141bf1 req-98fc94c9-f8a2-4e96-90d6-25c149768a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530770fb-25a6-4f3f-9658-f8c4767b4d08", "tag": "03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:00.695586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:00.695586 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:20:00.703369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5b7e22f7-c237-4d89-b7d0-df0794141bf1 req-98fc94c9-f8a2-4e96-90d6-25c149768a9f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:00.703818 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5b7e22f7-c237-4d89-b7d0-df0794141bf1 req-98fc94c9-f8a2-4e96-90d6-25c149768a9f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:00.714496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5b7e22f7-c237-4d89-b7d0-df0794141bf1 req-98fc94c9-f8a2-4e96-90d6-25c149768a9f service nova] Creating event network-changed:03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b for instance 530770fb-25a6-4f3f-9658-f8c4767b4d08 on hv-cinder-81322 Dec 15 14:20:00.720318 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5b7e22f7-c237-4d89-b7d0-df0794141bf1 req-98fc94c9-f8a2-4e96-90d6-25c149768a9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030154 Dec 15 14:20:00.720939 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 486/982] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:00.959947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-32b0b4fe-cd1f-4b9f-b024-220c3ecbc79d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb" status: 202 len: 0 microversion: 2.1 time: 0.438618 Dec 15 14:20:00.960737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 497/983] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:20:00 2021] DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/42951628-c8e9-4a5c-b0c6-93ab934f6efb => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:01.247705 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:01.248363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:01.255591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:01.256068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:01.256869 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:01.257304 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:01.395072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:01.403867 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4f2c155d-04cf-4fdb-bd66-e932ecd0de2e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.160794 Dec 15 14:20:01.404471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 487/984] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:01 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:02.422342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:02.423037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:02.429353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:02.429798 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:02.430569 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:02.431003 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:02.559439 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:02.567288 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-355ce5bf-8cc9-4398-a073-ec45b3013119 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.149696 Dec 15 14:20:02.567857 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 498/985] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:02 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:03.118682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:03.119689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:03.127486 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.127947 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.128729 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.129159 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.161259 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b7e8acbf-323c-473e-92bc-dc94b94b59aa tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/97ebd048-4ca9-40b2-8e62-011c45600784" status: 200 len: 194 microversion: 2.1 time: 0.048843 Dec 15 14:20:03.162047 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 488/986] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 14:20:03 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/97ebd048-4ca9-40b2-8e62-011c45600784 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:03.172995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:03.173155 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:03.179007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.179455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.180256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.180697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.257482 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lazy-loading 'services' on Instance uuid 0ad61711-58ee-4f49-8b73-a7879a8743ee {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:03.478357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-76166c13-490e-4e7f-a47e-bb4ec5153871 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/97ebd048-4ca9-40b2-8e62-011c45600784" status: 202 len: 0 microversion: 2.1 time: 0.309660 Dec 15 14:20:03.479045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 499/987] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 14:20:03 2021] DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments/97ebd048-4ca9-40b2-8e62-011c45600784 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:03.584080 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:03.585174 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:03.592584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.593073 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.594450 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:03.594929 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:03.733344 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:03.740556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-60ff7ca8-b497-4eb7-8e09-b4fd11ab771e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.160337 Dec 15 14:20:03.741114 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 489/988] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:03 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:04.631205 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:04.632296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:04.638309 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.638754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.639526 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.639975 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.668624 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-14601473-c45f-4f72-ad56-246152bd297d tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041967 Dec 15 14:20:04.669173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 500/989] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:20:04 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 14:20:04.757227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:04.757843 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:04.764508 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.764962 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.765830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.766342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.769037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:04.770184 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:04.775939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.776403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.777181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.777613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.809913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5b8f284a-7a1c-4183-96b9-923180eaaa62 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044758 Dec 15 14:20:04.810398 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 501/990] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 14:20:04 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 14:20:04.865652 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:04.866176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:04.871834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.872308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.873074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:04.873496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:04.898118 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:04.898835 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:04.906828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-015111d7-661e-4b49-93c7-38d5860fc751 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.152841 Dec 15 14:20:04.907494 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 490/991] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:04 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:05.211855 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-55bc07aa-2bc6-4862-96b8-6094066c6b12 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 204 len: 0 microversion: 2.1 time: 0.349677 Dec 15 14:20:05.212500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 502/992] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:04 2021] DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 14:20:05.221363 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:05.221982 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:05.227856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.228594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:05.229378 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.229815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:05.359557 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:05.366832 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8fb50b83-945a-4748-90e4-b28361a0aa95 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1671 microversion: 2.1 time: 0.149963 Dec 15 14:20:05.367345 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 491/993] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:05 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:05.925357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:05.925956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:05.932213 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.932654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:05.933417 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:05.933844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:06.068150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:06.075315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-193841f2-4fbb-4227-be93-d1294aa48109 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.155127 Dec 15 14:20:06.075881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 503/994] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:05 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:06.383906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:06.384539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:06.391089 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:06.391540 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:06.392356 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:06.392792 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:06.520375 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:06.527538 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-724bbbc5-30f4-4e0c-b0f1-5871e3d6d2b8 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1671 microversion: 2.1 time: 0.147352 Dec 15 14:20:06.528125 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 492/995] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:06 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:07.092351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:07.092980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:07.100107 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.100551 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.101340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.101767 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.236796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:07.244142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a80f0d6f-1a51-4e18-b80f-993c7ee45cb5 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.155466 Dec 15 14:20:07.254377 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 504/996] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:07 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:07.544778 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:07.545314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:07.552156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.552598 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.553368 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.553795 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.685647 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:07.694037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0eb23dbb-0b25-4a17-85d7-a70ebe0e7a3e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1671 microversion: 2.1 time: 0.153007 Dec 15 14:20:07.694622 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 493/997] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:07 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:07.910586 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-b09b7df7-aa25-4651-ac1f-982c8ac059a3 req-d48772f2-c1a9-46aa-901c-3ae779b8cc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530770fb-25a6-4f3f-9658-f8c4767b4d08", "name": "network-vif-plugged", "status": "completed", "tag": "03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:07.912178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:07.912178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:20:07.918983 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-b09b7df7-aa25-4651-ac1f-982c8ac059a3 req-d48772f2-c1a9-46aa-901c-3ae779b8cc85 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:07.919426 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-b09b7df7-aa25-4651-ac1f-982c8ac059a3 req-d48772f2-c1a9-46aa-901c-3ae779b8cc85 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:07.930535 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-b09b7df7-aa25-4651-ac1f-982c8ac059a3 req-d48772f2-c1a9-46aa-901c-3ae779b8cc85 service nova] Creating event network-vif-plugged:03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b for instance 530770fb-25a6-4f3f-9658-f8c4767b4d08 on hv-cinder-81322 Dec 15 14:20:07.935954 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-b09b7df7-aa25-4651-ac1f-982c8ac059a3 req-d48772f2-c1a9-46aa-901c-3ae779b8cc85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029533 Dec 15 14:20:07.936868 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 505/998] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:08.153383 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-4c7a7768-6691-418c-b5d6-444a4d9933d1 req-951f8d5d-535e-46b1-a6da-9f68bb0389da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad61711-58ee-4f49-8b73-a7879a8743ee", "name": "network-vif-deleted", "tag": "a281319e-ef68-4dae-9da6-2e3cb6b4f56a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:08.154993 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:08.154993 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:20:08.162349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4c7a7768-6691-418c-b5d6-444a4d9933d1 req-951f8d5d-535e-46b1-a6da-9f68bb0389da service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.162799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4c7a7768-6691-418c-b5d6-444a4d9933d1 req-951f8d5d-535e-46b1-a6da-9f68bb0389da service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.176253 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-4c7a7768-6691-418c-b5d6-444a4d9933d1 req-951f8d5d-535e-46b1-a6da-9f68bb0389da service nova] Creating event network-vif-deleted:a281319e-ef68-4dae-9da6-2e3cb6b4f56a for instance 0ad61711-58ee-4f49-8b73-a7879a8743ee on hv-cinder-81322 Dec 15 14:20:08.181426 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-4c7a7768-6691-418c-b5d6-444a4d9933d1 req-951f8d5d-535e-46b1-a6da-9f68bb0389da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Dec 15 14:20:08.182054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 494/999] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:08.262606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:08.263409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:08.275777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.276259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.277709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.278150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.433720 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:08.441879 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-07cd5800-18bb-48b7-bf56-6887ba5dfdcd tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.183875 Dec 15 14:20:08.442459 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 506/1000] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:08 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:08.710946 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:08.711642 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:08.719455 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.719981 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.720764 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.721201 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.752058 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:08.752515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:08.752967 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.objects.instance [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lazy-loading 'fault' on Instance uuid 0ad61711-58ee-4f49-8b73-a7879a8743ee {{(pid=116681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:08.791897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb651a254f441faa4e2588144cb2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e48568027f45a591f092080d89b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:08.799718 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3629c9dd-de12-49c3-84e9-ff5cc72e6ef7 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 200 len: 1326 microversion: 2.1 time: 0.092813 Dec 15 14:20:08.800315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 495/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:08 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:09.459322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:09.459871 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:09.466157 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.466606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.467382 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.467815 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.601641 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:09.609158 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a820846e-4d8b-4db5-9291-08fde7279dff tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1313 microversion: 2.1 time: 0.153639 Dec 15 14:20:09.610473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 507/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:09 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:09.816543 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:09.817215 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:09.823334 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.823781 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.824595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:09.825029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:09.838526 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. Dec 15 14:20:09.839110 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:09.839915 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6eb6d95e-aa43-48a0-9b4a-5e951b3b8dbd tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 404 len: 111 microversion: 2.1 time: 0.027200 Dec 15 14:20:09.840462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 496/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:09 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:20:09.849602 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0beba474-5919-4e11-963e-581dc7fb4e5e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '.version_select at 0x7f9cbeafa4c0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:09.911181 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0beba474-5919-4e11-963e-581dc7fb4e5e tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840361116" status: 202 len: 0 microversion: 2.1 time: 0.065555 Dec 15 14:20:09.911782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 508/1004] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Dec 15 14:20:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840361116 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 14:20:10.627402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:10.628065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:10.634296 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:10.636033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:10.636033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:10.636033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:10.765313 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:10.772936 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5efcb13b-6ca7-41f2-a093-8de7f93ab807 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1496 microversion: 2.1 time: 0.149994 Dec 15 14:20:10.773447 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 497/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:10 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:11.728844 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:11.729353 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:11.736347 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:11.736792 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:11.737569 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:11.738002 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:11.764701 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:12.044096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5a2e1c2b-b421-4a0a-8fda-434619bc7e0d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 204 len: 0 microversion: 2.1 time: 0.320256 Dec 15 14:20:12.044618 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 509/1006] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:11 2021] DELETE /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:20:12.052592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:12.053204 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:12.059452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:12.059898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:12.060703 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:12.061142 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:12.193438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:12.200639 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-0b3a055e-e71c-450f-80c8-a7f448e8b43e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1502 microversion: 2.1 time: 0.151839 Dec 15 14:20:12.201205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 498/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:12 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:13.158823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.159384 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.165758 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.166199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.166966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.167394 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.180901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. Dec 15 14:20:13.181520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:13.182327 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d4570d61-967f-43e5-ada0-b710ba0cae6c tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 404 len: 111 microversion: 2.1 time: 0.028070 Dec 15 14:20:13.182848 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 510/1008] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:13 2021] DELETE /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:20:13.191882 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.192903 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: 0ad61711-58ee-4f49-8b73-a7879a8743ee] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.198689 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.199133 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.199897 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.200352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.214120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. Dec 15 14:20:13.214692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance 0ad61711-58ee-4f49-8b73-a7879a8743ee could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:13.215666 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-515ffc4a-7b5d-442f-b70c-f5620d4bfbe4 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee" status: 404 len: 111 microversion: 2.1 time: 0.028431 Dec 15 14:20:13.216238 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 499/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:13 2021] GET /compute/v2.1/servers/0ad61711-58ee-4f49-8b73-a7879a8743ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:20:13.217948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.218738 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.225343 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.225789 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.226595 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.227030 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.361840 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:13.369271 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4c9b131a-bdf4-4e3b-ba1a-ef63ca331d28 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1502 microversion: 2.1 time: 0.154862 Dec 15 14:20:13.370007 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 511/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:13 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:13.646712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.647631 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.657433 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.657895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.658789 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.659120 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.693857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f37ca8ef-9e5b-4031-8f21-f213254e8e14 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050972 Dec 15 14:20:13.694431 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 500/1011] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 14:20:13 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:13.763485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:13.763485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:13.768561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.769123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.770371 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:13.771318 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:13.797744 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:14.071234 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5fe7f896-2b9a-45de-ac70-5f8e04b77490 req-b0d9d059-f6e2-47a7-8848-6e3aecaab8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530770fb-25a6-4f3f-9658-f8c4767b4d08", "name": "network-vif-deleted", "tag": "03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:14.072859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:14.072859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:20:14.080871 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5fe7f896-2b9a-45de-ac70-5f8e04b77490 req-b0d9d059-f6e2-47a7-8848-6e3aecaab8ca service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.081320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5fe7f896-2b9a-45de-ac70-5f8e04b77490 req-b0d9d059-f6e2-47a7-8848-6e3aecaab8ca service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.092327 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5fe7f896-2b9a-45de-ac70-5f8e04b77490 req-b0d9d059-f6e2-47a7-8848-6e3aecaab8ca service nova] Creating event network-vif-deleted:03e81c0c-8c9b-4e19-97e9-ab7d197ebf6b for instance 530770fb-25a6-4f3f-9658-f8c4767b4d08 on hv-cinder-81322 Dec 15 14:20:14.097477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5fe7f896-2b9a-45de-ac70-5f8e04b77490 req-b0d9d059-f6e2-47a7-8848-6e3aecaab8ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029929 Dec 15 14:20:14.098038 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 501/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:14.101895 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c0cacca9-a78e-42a2-be9c-e2dc45904b2f tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 204 len: 0 microversion: 2.20 time: 0.349769 Dec 15 14:20:14.102477 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 512/1013] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 14:20:13 2021] DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:20:14.111863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:14.112831 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:14.118839 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.119292 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.120218 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.120692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.256248 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:14.264116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:14.265712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:14.266892 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6008d37b-91ee-47e0-a5a2-7112e5557415 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.159642 Dec 15 14:20:14.267459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 502/1014] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:14 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 14:20:14.387464 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:14.388200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:14.394622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.395072 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.395847 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.396309 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.427334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.427775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.428246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lazy-loading 'fault' on Instance uuid 530770fb-25a6-4f3f-9658-f8c4767b4d08 {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:14.468063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:14.475543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4cbbe1c6-1c42-472d-990a-f5b5ef543f7d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 200 len: 1303 microversion: 2.1 time: 0.092102 Dec 15 14:20:14.476134 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 513/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:14 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:14.478559 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:14.479044 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:14.485714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.486160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.486999 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.487432 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.501401 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. Dec 15 14:20:14.501979 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:14.502828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-78aea248-fd99-4bc2-a94e-3349183f4c43 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 404 len: 111 microversion: 2.1 time: 0.028409 Dec 15 14:20:14.503387 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 503/1016] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:14 2021] DELETE /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:20:14.511332 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:14.511936 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] [instance: ef62bed0-b1e8-4769-878e-4dc0bbb2c15f] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:14.517881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.518335 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.519123 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:14.519560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:14.532922 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] HTTP exception thrown: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. Dec 15 14:20:14.533507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] Returning 404 to user: Instance ef62bed0-b1e8-4769-878e-4dc0bbb2c15f could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:14.534323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-25c55e5c-8945-45c7-9ba2-568eeaf1e695 tempest-AttachVolumeTestJSON-886690549 tempest-AttachVolumeTestJSON-886690549-project] 10.222.0.36 "GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f" status: 404 len: 111 microversion: 2.1 time: 0.026831 Dec 15 14:20:14.534853 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 514/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:14 2021] GET /compute/v2.1/servers/ef62bed0-b1e8-4769-878e-4dc0bbb2c15f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:20:15.285394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:15.286012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:15.292239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.292693 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.293609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.294054 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.493708 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:15.494415 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 530770fb-25a6-4f3f-9658-f8c4767b4d08] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:15.501008 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.501517 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.502304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:15.502735 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:15.517130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] HTTP exception thrown: Instance 530770fb-25a6-4f3f-9658-f8c4767b4d08 could not be found. Dec 15 14:20:15.517750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Returning 404 to user: Instance 530770fb-25a6-4f3f-9658-f8c4767b4d08 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:15.518625 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b32cc2a6-5687-4071-9692-735426cb944d tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08" status: 404 len: 111 microversion: 2.1 time: 0.028806 Dec 15 14:20:15.519255 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 515/1018] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:15 2021] GET /compute/v2.1/servers/530770fb-25a6-4f3f-9658-f8c4767b4d08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 14:20:15.569131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1323225173", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452", "networks": [{"uuid": "bb4e1880-84ea-4fab-ae20-ce3f398a76b0"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:15.607804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:15.622594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:15.627105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:15.628628 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-86f59359-0e0d-4ee8-b619-3d9b4c9c21af tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.347197 Dec 15 14:20:15.629776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 504/1019] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:15 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:15.646008 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] validate_networks() for [('bb4e1880-84ea-4fab-ae20-ce3f398a76b0', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:20:16.032148 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:20:16.032966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:20:16.033152 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:20:16.033653 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:20:16.034154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:20:16.042942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.043475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.044407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.045031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.065813 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Getting quotas for project d84c55322ce848ae8db4d5528bc6d79f. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:20:16.070580 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Getting quotas for user 024d5cf69a5047279754065c6f675475 and project d84c55322ce848ae8db4d5528bc6d79f. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:20:16.081643 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:20:16.084057 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:20:16.217143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0b6bb839-2bde-4f5e-ae1a-7f41b3cf1cc7 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652032 Dec 15 14:20:16.218017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 516/1020] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:20:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:20:16.229818 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-22f16ff5-0f08-4f1f-aa2d-4115d2fd6fcc tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:16.231042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-22f16ff5-0f08-4f1f-aa2d-4115d2fd6fcc tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:16.286004 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-22f16ff5-0f08-4f1f-aa2d-4115d2fd6fcc tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:16.292886 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-22f16ff5-0f08-4f1f-aa2d-4115d2fd6fcc tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1214 microversion: 2.1 time: 0.067831 Dec 15 14:20:16.293522 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 505/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:16 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:16.649059 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:16.649658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:16.655631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.657217 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.658013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:16.658447 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:16.816014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:16.825727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:16.832136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:16.832136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f10b41ad-f6a0-48e7-bf73-9c91d9ce38c1 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1722 microversion: 2.20 time: 0.185087 Dec 15 14:20:16.832136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 517/1022] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:16 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:17.331119 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:17.332001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-d51810c3-6887-400e-90a8-09c317590c3f req-16b86b27-31d1-48a4-b015-8b4ed37c21a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba5304f-71f5-478d-9a3b-80f90a1cbb9c", "name": "network-vif-deleted", "tag": "ddb42df2-bffe-4eca-bd92-bb43eef42752"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:17.332898 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:17.334775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:17.334775 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:20:17.359760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-d51810c3-6887-400e-90a8-09c317590c3f req-16b86b27-31d1-48a4-b015-8b4ed37c21a7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.359760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-d51810c3-6887-400e-90a8-09c317590c3f req-16b86b27-31d1-48a4-b015-8b4ed37c21a7 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.360561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.361180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.362153 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.362697 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.392833 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-d51810c3-6887-400e-90a8-09c317590c3f req-16b86b27-31d1-48a4-b015-8b4ed37c21a7 service nova] Creating event network-vif-deleted:ddb42df2-bffe-4eca-bd92-bb43eef42752 for instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c on hv-cinder-81322 Dec 15 14:20:17.403403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-d51810c3-6887-400e-90a8-09c317590c3f req-16b86b27-31d1-48a4-b015-8b4ed37c21a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087129 Dec 15 14:20:17.407289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 518/1023] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:17.470794 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:17.479063 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-c84ace78-0d99-4444-bbd6-e4e7a2e64981 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1218 microversion: 2.1 time: 0.172221 Dec 15 14:20:17.481424 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 506/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:17 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:17.849285 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:17.850757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:17.858074 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.858670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.859722 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.860291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.893156 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:17.893748 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:17.894299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lazy-loading 'fault' on Instance uuid dba5304f-71f5-478d-9a3b-80f90a1cbb9c {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:17.963956 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:17.985912 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:17.987886 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a320b1bc4704b91b202e253cd428373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d09ce10de40483aa9ac94558a84aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:17.989186 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9299c029-6c8d-430d-87e8-ce7db352e3e2 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 200 len: 1371 microversion: 2.20 time: 0.144067 Dec 15 14:20:17.990535 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 519/1025] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:17 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 14:20:18.498602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:18.508197 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:18.515726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.516712 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.517605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:18.518043 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:18.906423 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:18.929887 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a3e4de45-2e4f-46aa-92f6-9cbba011e66f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1284 microversion: 2.1 time: 0.434930 Dec 15 14:20:18.931272 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 507/1026] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:18 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1284 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:19.018774 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:19.020208 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:19.028416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.029289 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:19.034760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.036808 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:19.062095 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. Dec 15 14:20:19.063471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:19.064555 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3108c797-20d4-4752-a9d0-c3366601fc64 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 404 len: 111 microversion: 2.20 time: 0.060723 Dec 15 14:20:19.066391 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 520/1027] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:19 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:20:19.074782 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-79b547a9-9200-422a-b610-02a3d924d192 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '.version_select at 0x7f9cbe149940>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:19.192439 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-79b547a9-9200-422a-b610-02a3d924d192 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105277184" status: 204 len: 0 microversion: 2.20 time: 0.113847 Dec 15 14:20:19.192439 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 508/1028] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Dec 15 14:20:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105277184 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 14:20:19.948712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:19.949408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:19.956093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.956541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:19.958658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:19.958658 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:20.245277 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:20.263283 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d51f899f-d728-4698-bbdb-82262654c897 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.318305 Dec 15 14:20:20.267715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 521/1029] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:19 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:20.599479 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-96cc1901-0e54-4865-9b74-606d1a2e7dcb req-45fe3d99-7c45-4e4e-b569-74251949b9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e20b40-923b-4045-aa3c-34170136fd03", "tag": "ef214923-9000-4e46-8e3d-f237b83c8851"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:20.602501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:20.602501 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:20:20.612398 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-96cc1901-0e54-4865-9b74-606d1a2e7dcb req-45fe3d99-7c45-4e4e-b569-74251949b9f8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:20.613475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-96cc1901-0e54-4865-9b74-606d1a2e7dcb req-45fe3d99-7c45-4e4e-b569-74251949b9f8 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:20.624834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-96cc1901-0e54-4865-9b74-606d1a2e7dcb req-45fe3d99-7c45-4e4e-b569-74251949b9f8 service nova] Creating event network-changed:ef214923-9000-4e46-8e3d-f237b83c8851 for instance 64e20b40-923b-4045-aa3c-34170136fd03 on hv-cinder-81322 Dec 15 14:20:20.629805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-96cc1901-0e54-4865-9b74-606d1a2e7dcb req-45fe3d99-7c45-4e4e-b569-74251949b9f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036680 Dec 15 14:20:20.630390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 509/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:21.284565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:21.285182 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:21.291632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.295093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.295093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.295093 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.431863 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:21.440809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-e8ca1923-58c1-43b1-8ef2-08f8cd300e97 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.160260 Dec 15 14:20:21.441380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 522/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:21 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:21.543984 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:21.544573 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:21.550594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.551127 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.552026 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.552533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.566457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. Dec 15 14:20:21.567149 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:21.568046 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7b45af5b-6ecc-49ff-9da6-ca13c8df5063 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 404 len: 111 microversion: 2.20 time: 0.027874 Dec 15 14:20:21.568579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 523/1032] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 14:20:21 2021] DELETE /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 14:20:21.576230 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:21.576959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: dba5304f-71f5-478d-9a3b-80f90a1cbb9c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:21.583294 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.583739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.584654 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:21.585262 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:21.598190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. Dec 15 14:20:21.598772 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance dba5304f-71f5-478d-9a3b-80f90a1cbb9c could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:21.599582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-eeee0788-4b08-485c-93a8-3ea008024469 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c" status: 404 len: 111 microversion: 2.20 time: 0.026889 Dec 15 14:20:21.600141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 524/1033] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:21 2021] GET /compute/v2.1/servers/dba5304f-71f5-478d-9a3b-80f90a1cbb9c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 14:20:21.626037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-68c13a5f-b127-480c-9538-95731dcc79ea tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Action: 'create', calling method: .version_select at 0x7f9cbe1490d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1746471786", "metadata": {"Type": "work"}}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:22.293182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-68c13a5f-b127-480c-9538-95731dcc79ea tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.796355 Dec 15 14:20:22.293803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 510/1034] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 14:20:21 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 798 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 15 14:20:22.305707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f3cc04a8-4daa-4120-8029-41374696191e tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbe8b71f0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.353933 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f3cc04a8-4daa-4120-8029-41374696191e tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 200 len: 353 microversion: 2.1 time: 0.051971 Dec 15 14:20:22.354493 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 525/1035] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:22 2021] GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:22.457556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.458283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:22.465228 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.465708 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.466513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.466948 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.598369 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:22.605812 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fccb6b37-8d3c-43f3-b0d3-596fb89c6284 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.152204 Dec 15 14:20:22.606376 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 511/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:22 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:22.855793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.856344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:22.863542 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.864022 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.864804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.865244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.878281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. Dec 15 14:20:22.884286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:22.884286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f0030bcb-5592-41da-841e-aa8f10074b28 tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 404 len: 111 microversion: 2.20 time: 0.027945 Dec 15 14:20:22.884286 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 526/1037] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 14:20:22 2021] DELETE /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:20:22.891504 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:22.892146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] [instance: 8631f02e-761c-4b6a-9b55-fd29ddfe47d8] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:22.898022 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.898474 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.899250 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:22.899682 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:22.912471 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] HTTP exception thrown: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. Dec 15 14:20:22.913051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] Returning 404 to user: Instance 8631f02e-761c-4b6a-9b55-fd29ddfe47d8 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:22.913854 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-32b35558-0c6e-48d5-ab9d-6e58dcd56c4a tempest-AttachVolumeShelveTestJSON-63210387 tempest-AttachVolumeShelveTestJSON-63210387-project] 10.222.0.36 "GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8" status: 404 len: 111 microversion: 2.20 time: 0.026937 Dec 15 14:20:22.914371 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 512/1038] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 14:20:22 2021] GET /compute/v2.1/servers/8631f02e-761c-4b6a-9b55-fd29ddfe47d8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 14:20:23.367312 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4f28f084-493e-4761-8935-9dd166992e1a tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbe8b7820>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.413960 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4f28f084-493e-4761-8935-9dd166992e1a tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 200 len: 354 microversion: 2.1 time: 0.050463 Dec 15 14:20:23.414530 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 527/1039] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:23.425808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-44979088-e526-479c-a9a0-29cc7c97802e tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbe159160>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.472959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-44979088-e526-479c-a9a0-29cc7c97802e tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 200 len: 354 microversion: 2.1 time: 0.051372 Dec 15 14:20:23.473601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 513/1040] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:23.485281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-996d7e59-1017-4ecc-84ff-c87da8a0ca58 tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbe971b80>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.623069 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.623600 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:23.630858 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.631311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.632217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:23.632660 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:23.662995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-996d7e59-1017-4ecc-84ff-c87da8a0ca58 tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 202 len: 0 microversion: 2.1 time: 0.181441 Dec 15 14:20:23.663702 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 528/1041] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 14:20:23 2021] DELETE /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:20:23.674947 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7f429cb3-ad9e-4673-9c77-4248ad3a26d2 tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbeba4ee0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:23.737254 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7f429cb3-ad9e-4673-9c77-4248ad3a26d2 tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 200 len: 353 microversion: 2.1 time: 0.065609 Dec 15 14:20:23.737911 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 529/1042] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:23.783621 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:23.791417 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4101370b-9221-4978-928e-5cb77a361d44 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.172698 Dec 15 14:20:23.792043 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 514/1043] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:23 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:20:24.750408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-70c15f94-95ea-464c-bcbe-b2d709c2612f tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Calling method '.version_select at 0x7f9cbea6e280>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:24.780432 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-70c15f94-95ea-464c-bcbe-b2d709c2612f tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] HTTP exception thrown: Volume b9275b71-129c-469a-8a56-22a10fae9522 could not be found. Dec 15 14:20:24.781567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-70c15f94-95ea-464c-bcbe-b2d709c2612f tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] Returning 404 to user: Volume b9275b71-129c-469a-8a56-22a10fae9522 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:24.782670 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-70c15f94-95ea-464c-bcbe-b2d709c2612f tempest-VolumesGetTestJSON-1563577308 tempest-VolumesGetTestJSON-1563577308-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522" status: 404 len: 109 microversion: 2.1 time: 0.036922 Dec 15 14:20:24.790736 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 530/1044] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:24 2021] GET /compute/v2.1/os-volumes/b9275b71-129c-469a-8a56-22a10fae9522 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:20:24.814957 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:24.816453 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:24.841179 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.841942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:24.842933 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:24.844268 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:25.042135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:25.053693 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-253d2e1b-d95f-49ad-aa79-e6120f1b287f tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.246188 Dec 15 14:20:25.065932 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 515/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:24 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:26.075370 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:26.076639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:26.108352 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.108352 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.119746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.120195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.207408 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-4748f501-5b86-4a26-9ce5-14c1c368155c req-9c91d64e-6ad4-4882-8b70-ef969e90fa6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e20b40-923b-4045-aa3c-34170136fd03", "name": "network-vif-plugged", "status": "completed", "tag": "ef214923-9000-4e46-8e3d-f237b83c8851"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:26.209288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:26.209288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:20:26.219187 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4748f501-5b86-4a26-9ce5-14c1c368155c req-9c91d64e-6ad4-4882-8b70-ef969e90fa6a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:26.220025 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-4748f501-5b86-4a26-9ce5-14c1c368155c req-9c91d64e-6ad4-4882-8b70-ef969e90fa6a service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:26.241305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-4748f501-5b86-4a26-9ce5-14c1c368155c req-9c91d64e-6ad4-4882-8b70-ef969e90fa6a service nova] Creating event network-vif-plugged:ef214923-9000-4e46-8e3d-f237b83c8851 for instance 64e20b40-923b-4045-aa3c-34170136fd03 on hv-cinder-81322 Dec 15 14:20:26.256258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-4748f501-5b86-4a26-9ce5-14c1c368155c req-9c91d64e-6ad4-4882-8b70-ef969e90fa6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053674 Dec 15 14:20:26.257567 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 516/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:26.445986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:26.472633 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1c8f6c66-e26f-4e06-aa9b-68a2621d192e tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.403331 Dec 15 14:20:26.473355 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 531/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:26 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:27.491032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:27.491727 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:27.498640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.499604 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.501053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:27.501487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:27.650145 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:27.659808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e53f529c-1e9c-4c26-bb13-22f54ef5c6f4 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1314 microversion: 2.1 time: 0.172910 Dec 15 14:20:27.669906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 517/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:27 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:28.679988 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:28.681014 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:28.690819 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.691552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.692877 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:28.693588 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:28.840144 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:28.848258 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b90aa4d5-e74d-4067-9116-6ecc632f3932 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cc3862d30>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:28.859976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-471edf59-3c5b-4498-b14c-952ccbf28df9 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1497 microversion: 2.1 time: 0.186107 Dec 15 14:20:28.860567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 532/1049] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:28 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:28.904019 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b90aa4d5-e74d-4067-9116-6ecc632f3932 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8fda467e-68ed-45e8-9d80-c0e441daccc9" status: 200 len: 351 microversion: 2.1 time: 0.059294 Dec 15 14:20:28.905853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 518/1050] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:28 2021] GET /compute/v2.1/os-volumes/8fda467e-68ed-45e8-9d80-c0e441daccc9 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:20:29.738011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:29.738514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:29.744823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.745265 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.746045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:29.746479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:29.770742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:20:30.063615 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-934f8ca8-f0c0-4547-9642-7e08a02d3198 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 204 len: 0 microversion: 2.1 time: 0.329632 Dec 15 14:20:30.064322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 533/1051] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:20:29 2021] DELETE /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:20:30.080247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:30.080837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:30.087190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.087636 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.088459 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:30.088891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:30.219721 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:30.227123 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-314b5989-00e6-4757-9b60-a0261f6b2438 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1503 microversion: 2.1 time: 0.151887 Dec 15 14:20:30.227676 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 519/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:30 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:30.752322 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c8ee5818-81d0-4d84-ad27-14a2b5a6d8de tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbeb41e50>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:30.800414 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c8ee5818-81d0-4d84-ad27-14a2b5a6d8de tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1c5edc6d-2500-4da0-9246-026e00373482" status: 200 len: 351 microversion: 2.1 time: 0.052125 Dec 15 14:20:30.801579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 534/1053] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:30 2021] GET /compute/v2.1/os-volumes/1c5edc6d-2500-4da0-9246-026e00373482 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:31.250208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:31.251013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:31.258102 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:31.258606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:31.259478 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:31.260071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:31.419314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:31.432185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ff303d8b-bcca-4b3d-84d2-331520610029 tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1503 microversion: 2.1 time: 0.189069 Dec 15 14:20:31.432934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 520/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:31 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:32.204298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-726c6f9b-11d6-4d38-a094-011e2f6c4822 req-531be1af-cad6-4c54-9c88-b429ca4f2328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e20b40-923b-4045-aa3c-34170136fd03", "name": "network-vif-deleted", "tag": "ef214923-9000-4e46-8e3d-f237b83c8851"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:20:32.205963 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:20:32.205963 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:20:32.214015 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-726c6f9b-11d6-4d38-a094-011e2f6c4822 req-531be1af-cad6-4c54-9c88-b429ca4f2328 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.214492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-726c6f9b-11d6-4d38-a094-011e2f6c4822 req-531be1af-cad6-4c54-9c88-b429ca4f2328 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.225910 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-726c6f9b-11d6-4d38-a094-011e2f6c4822 req-531be1af-cad6-4c54-9c88-b429ca4f2328 service nova] Creating event network-vif-deleted:ef214923-9000-4e46-8e3d-f237b83c8851 for instance 64e20b40-923b-4045-aa3c-34170136fd03 on hv-cinder-81322 Dec 15 14:20:32.230930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-726c6f9b-11d6-4d38-a094-011e2f6c4822 req-531be1af-cad6-4c54-9c88-b429ca4f2328 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Dec 15 14:20:32.231525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 535/1055] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.437648 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ebf06246-5d67-4486-ae81-5c90eab23cb8 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe144c10>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.450821 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.451187 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:32.458508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.458976 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.459754 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.460207 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.488592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ebf06246-5d67-4486-ae81-5c90eab23cb8 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e2b78109-fdad-4bd2-bb1b-3802e329a2e8" status: 200 len: 350 microversion: 2.1 time: 0.054552 Dec 15 14:20:32.489156 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 521/1056] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes/e2b78109-fdad-4bd2-bb1b-3802e329a2e8 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.501750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-efa67b5a-3d83-4ab2-a54f-f668ef6eacdc tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe149af0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.504177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:32.504686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:32.505253 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lazy-loading 'fault' on Instance uuid 64e20b40-923b-4045-aa3c-34170136fd03 {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:20:32.559757 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024d5cf69a5047279754065c6f675475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84c55322ce848ae8db4d5528bc6d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:20:32.569096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b27e2ef9-fa64-4d52-8753-6f47b8ac08ea tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 200 len: 1304 microversion: 2.1 time: 0.122736 Dec 15 14:20:32.569686 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 536/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:32.603905 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-efa67b5a-3d83-4ab2-a54f-f668ef6eacdc tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107284 Dec 15 14:20:32.604627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 522/1058] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:32.620556 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-afb45585-20b8-4fd0-8c3c-53eb1fe8d2c0 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbeb52c10>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.698795 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-afb45585-20b8-4fd0-8c3c-53eb1fe8d2c0 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085317 Dec 15 14:20:32.699364 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 537/1059] 10.222.0.36 () {58 vars in 1148 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.711065 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-45a40157-0ea2-4a4c-8a7f-bc324644bbc0 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe1261f0>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.791997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-45a40157-0ea2-4a4c-8a7f-bc324644bbc0 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084433 Dec 15 14:20:32.792573 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 523/1060] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:32.804351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bcf71ae3-66b2-4bb5-a16a-3183c958402a tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe81cee0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.888905 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bcf71ae3-66b2-4bb5-a16a-3183c958402a tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088336 Dec 15 14:20:32.890050 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 538/1061] 10.222.0.36 () {58 vars in 1166 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.902184 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4eb95274-46dd-4de7-a256-09f02c8c4007 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe126a60>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:32.983895 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4eb95274-46dd-4de7-a256-09f02c8c4007 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085546 Dec 15 14:20:32.984573 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 524/1062] 10.222.0.36 () {58 vars in 1169 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:32.996034 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-242dc7b6-2361-44f7-a317-1951045e0b0b tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbea33f70>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.086236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-242dc7b6-2361-44f7-a317-1951045e0b0b tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087760 Dec 15 14:20:33.086236 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 539/1063] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Dec 15 14:20:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:33.091704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-fcdfae21-5562-4f38-8b85-58f420ee8442 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbe144160>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.173876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-fcdfae21-5562-4f38-8b85-58f420ee8442 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085796 Dec 15 14:20:33.174449 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 525/1064] 10.222.0.36 () {58 vars in 1187 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:20:33.185896 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9aaec47f-e503-4608-8518-7923d569ff58 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] Calling method '.version_select at 0x7f9cbea338b0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.268088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9aaec47f-e503-4608-8518-7923d569ff58 tempest-VolumesTestJSON-788670157 tempest-VolumesTestJSON-788670157-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085608 Dec 15 14:20:33.271793 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 540/1065] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:20:33.587239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:20:33.588015 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] [instance: 64e20b40-923b-4045-aa3c-34170136fd03] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:20:33.594387 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.594837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.595609 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:20:33.596070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:20:33.609342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] HTTP exception thrown: Instance 64e20b40-923b-4045-aa3c-34170136fd03 could not be found. Dec 15 14:20:33.609938 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] Returning 404 to user: Instance 64e20b40-923b-4045-aa3c-34170136fd03 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:20:33.610969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-efa69f9b-c2d5-417e-88e0-1aba1a2f64fe tempest-VolumesActionsTest-1134173251 tempest-VolumesActionsTest-1134173251-project] 10.222.0.36 "GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03" status: 404 len: 111 microversion: 2.1 time: 0.027847 Dec 15 14:20:33.611500 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 526/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:20:33 2021] GET /compute/v2.1/servers/64e20b40-923b-4045-aa3c-34170136fd03 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:21:09.207520 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:09.209216 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:09.214452 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.214899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.215680 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.216154 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.242709 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lazy-loading 'flavor' on Instance uuid 623f52db-82aa-423a-9b24-6eeac638c872 {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:21:09.530898 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-02212a54-5f68-4f23-b220-f5d4969c15ba tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "POST /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872/action" status: 202 len: 0 microversion: 2.1 time: 0.327631 Dec 15 14:21:09.531569 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 541/1067] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:21:09 2021] POST /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:09.541556 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:09.542212 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:09.548952 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.549402 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.550210 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:09.550893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:09.691632 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:09.699745 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9b9b8298-b65b-4421-8a83-fc284d6a53bc tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.162574 Dec 15 14:21:09.700326 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 527/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:09 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:10.718314 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:10.719000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:10.726380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.726826 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.727614 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:10.728068 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:10.868692 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:10.876500 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d70343f1-2601-4716-b121-be5f9a745fcb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.162628 Dec 15 14:21:10.877012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 542/1069] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:10 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:11.894391 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:11.895023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:11.901772 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.902230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:11.903015 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:11.903487 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:12.039885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:12.047142 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-990dd06f-68bc-45f6-8cf8-2e8f914e65a0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.156739 Dec 15 14:21:12.047707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 528/1070] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:11 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:13.066661 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:13.067367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:13.074567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.075019 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.075823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:13.076279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:13.214787 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:13.222340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-9bb8509c-9ab6-449c-a090-d18ce6ce4271 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.159766 Dec 15 14:21:13.224379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 543/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:13 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:14.239068 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:14.239685 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:14.246490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.247039 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.248105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:14.248542 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:14.383709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:14.391277 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-23c9fbc9-10a9-4fa5-9bc4-8045ed3dda8c tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.155850 Dec 15 14:21:14.391857 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 529/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:14 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:15.409727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:15.410468 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:15.417290 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.417919 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.418746 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:15.419179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:15.559088 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:15.567367 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-16ea6cbd-0485-4e7a-ada8-09eb377d2912 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.162082 Dec 15 14:21:15.575986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 544/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:15 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:16.585313 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:16.585964 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:16.593171 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:16.593618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:16.594386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:16.594833 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:16.731358 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:16.744596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4f6d179c-c6c2-4ae4-97f1-0da0a57d04d4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.162955 Dec 15 14:21:16.746051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 530/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:16 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:17.762096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:17.762707 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:17.769028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.769472 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.770237 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:17.770669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:17.916103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:17.923562 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-d62ce5c6-bbd1-4ddc-a98b-4bd561bc253d tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.165343 Dec 15 14:21:17.924164 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 545/1075] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:17 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:18.940293 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:18.940906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:18.947199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.947654 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:18.948496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:18.948934 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:19.078288 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:19.085596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e6aec6fb-10b3-48d3-a3bd-30715cd44b39 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.149088 Dec 15 14:21:19.086322 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 531/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:18 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:20.102966 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:20.103525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:20.110053 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.110506 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.117453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:20.117453 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:20.248340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:20.255881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-0bd2766a-093b-4468-92b6-2156af8008a7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.156886 Dec 15 14:21:20.256368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 546/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:20 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:21.272713 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:21.273435 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:21.279798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.280286 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.281077 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:21.281515 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:21.416698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:21.423990 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5d8aea31-acc2-4449-abfb-94153b1484e7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.155079 Dec 15 14:21:21.424551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 532/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:21 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:22.441179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:22.441825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:22.448714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.449232 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.450092 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:22.450639 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:22.586380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:22.593935 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-29cd6eb2-c3d7-45ce-a4b8-fd14f955e803 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.156552 Dec 15 14:21:22.594592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 547/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:22 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:23.611943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:23.612671 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:23.619595 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.620070 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.620863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:23.621298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:23.757056 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:23.764445 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-f07f1e7f-f671-4cfd-a138-0b940fee1e21 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.156271 Dec 15 14:21:23.765005 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 533/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:23 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:24.782622 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:24.783268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:24.789543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.789993 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.791313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:24.791750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:24.925305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:24.933558 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ce5b6ed2-8dd0-480d-a31b-5e4b83bfaeea tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.154798 Dec 15 14:21:24.934122 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 548/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:24 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:25.951606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:25.952276 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:25.958945 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.959397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:25.960281 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:25.960805 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.116517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:26.128917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7be88fb4-ca0e-46d2-9379-ada6d93b706a tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1509 microversion: 2.1 time: 0.182126 Dec 15 14:21:26.130251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 534/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:25 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:26.151357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:26.152195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:26.159886 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.160443 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.161340 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.162931 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.441395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2711e03f-5a75-423b-9337-ccbcb057adfb tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "POST /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872/action" status: 202 len: 0 microversion: 2.1 time: 0.296794 Dec 15 14:21:26.442378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 549/1083] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 14:21:26 2021] POST /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:21:26.450392 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:26.451129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:26.457324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.457767 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.458539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:26.458968 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:26.609129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:26.616603 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-44d2f9a2-ee79-4356-8e27-1a9118781b20 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1517 microversion: 2.1 time: 0.170169 Dec 15 14:21:26.617232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 535/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:26 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:21:27.633422 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:27.634449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:27.641090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.641592 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.642593 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:27.643031 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:27.807018 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:27.814473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-1d6776bc-2cff-4cd9-8184-48b9c7b419ff tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1519 microversion: 2.1 time: 0.184740 Dec 15 14:21:27.815986 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 550/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:27 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:28.220390 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-338ec8e0-aa28-42a8-a938-27ce5c7cae98 req-b60dfdb4-03a8-44b0-847a-7223953a0ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "name": "network-vif-unplugged", "status": "completed", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:28.222329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:21:28.222329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:21:28.234217 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-338ec8e0-aa28-42a8-a938-27ce5c7cae98 req-b60dfdb4-03a8-44b0-847a-7223953a0ae6 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.234665 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-338ec8e0-aa28-42a8-a938-27ce5c7cae98 req-b60dfdb4-03a8-44b0-847a-7223953a0ae6 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.246516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.compute.server_external_events [req-338ec8e0-aa28-42a8-a938-27ce5c7cae98 req-b60dfdb4-03a8-44b0-847a-7223953a0ae6 service nova] Unable to find a host for instance 623f52db-82aa-423a-9b24-6eeac638c872. Dropping event network-vif-unplugged {{(pid=116681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 14:21:28.247393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-338ec8e0-aa28-42a8-a938-27ce5c7cae98 req-b60dfdb4-03a8-44b0-847a-7223953a0ae6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033312 Dec 15 14:21:28.248038 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 536/1086] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 15 14:21:28.832107 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:28.832714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:28.839610 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.840161 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.841027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:28.841507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:28.993077 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:29.001796 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6a9ac934-f5fa-4393-8dde-9446bc61d96b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1519 microversion: 2.1 time: 0.173465 Dec 15 14:21:29.002514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 551/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:28 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:30.019181 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:30.019704 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:30.026828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.027574 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.028569 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:30.029170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:30.168461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:30.176164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4158600e-6045-4363-8307-12606b829511 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.160669 Dec 15 14:21:30.183488 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 537/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:30 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:31.197866 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:31.198513 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:31.204943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.205516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.206403 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:31.206939 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:31.351168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:31.359598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-75c43333-8a5d-4ccc-b41f-2a42eff0a0c7 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.167361 Dec 15 14:21:31.370560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 552/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:31 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:32.380949 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:32.382095 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:32.390049 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.390894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.391684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:32.392150 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:32.549856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:32.558590 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-2535e6a0-cb49-4bfb-80b1-dee5935745c3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.183812 Dec 15 14:21:32.559272 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 538/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:32 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:33.576318 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:33.577687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:33.584268 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.584845 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.585727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:33.586226 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:33.727042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:33.734564 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c6146c6e-a717-4ac2-b15c-746494deb412 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.162731 Dec 15 14:21:33.735142 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 553/1091] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:33 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:34.751731 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:34.752994 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:34.759509 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.759977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.760787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:34.761236 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:34.912089 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:34.921050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-bf0e1f2a-98fd-45d4-99b2-dddd4f7443a4 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.172834 Dec 15 14:21:34.928186 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 539/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:34 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:35.938571 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:35.939189 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:35.958360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.971525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:35.972430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:35.972875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:36.234515 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:36.244489 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ce9931dd-1a70-4241-8039-04f2b91e843b tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.309089 Dec 15 14:21:36.245233 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 554/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:35 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:37.260624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:37.261237 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:37.267517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.268000 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.268780 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:37.269216 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:37.535744 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:37.544160 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-9dde9fb2-42d5-4d5b-9ddd-2f0e47a95099 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.287274 Dec 15 14:21:37.544911 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 540/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:37 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:38.562033 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:38.563608 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:38.570222 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.570806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.572471 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:38.573024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:38.799365 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:38.807567 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-dc09b1b2-79bb-4c82-ad9b-1a04deaeb3b0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.249660 Dec 15 14:21:38.808167 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 555/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:38 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:39.824355 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:39.824977 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:39.835124 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.835591 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:39.836425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:39.837573 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:40.083290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:40.096219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8ba25e06-81af-4c04-ac12-450c217b3a8f tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.276178 Dec 15 14:21:40.098013 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 541/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:39 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:40.397409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Action: 'create', calling method: .version_select at 0x7f9cbeb41d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-58796565"}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:40.407786 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for project cd38f26fb8464e569d886ee7fa407464. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:21:40.411825 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for user d9f2199655a14be1b65ddce9c76d789c and project cd38f26fb8464e569d886ee7fa407464. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:21:40.769195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for project cd38f26fb8464e569d886ee7fa407464. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:21:40.773140 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for user d9f2199655a14be1b65ddce9c76d789c and project cd38f26fb8464e569d886ee7fa407464. Resources: {'key_pairs'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:21:40.786928 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-84b663d6-2094-41da-bf25-9584c285a549 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.583997 Dec 15 14:21:40.787533 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 556/1097] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 14:21:40 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:41.116558 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:41.117628 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:41.124463 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.124846 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.125625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:41.126071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:41.306089 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:41.313885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3a105e38-5a3d-4c43-864b-0026d87747a6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.201132 Dec 15 14:21:41.314456 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 542/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:41 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:42.335194 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:42.341409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:42.348598 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.349044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.349822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:42.350463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:42.525281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:42.532942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c2b8a201-3d95-48fd-973b-8382e4bca477 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.202243 Dec 15 14:21:42.533543 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 557/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:42 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:43.551310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:43.551955 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:43.559310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.559772 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.563468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:43.568489 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:43.724145 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:43.733670 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7168ac39-4f1c-4bd1-aeec-a1cec270be64 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.186549 Dec 15 14:21:43.734477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 543/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:43 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:44.361568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-57f3525d-347c-4f93-906e-d22358af6fc5 req-bffb14d5-811b-476a-b302-2621209162ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "name": "network-vif-plugged", "status": "completed", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:21:44.364256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:21:44.364256 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:21:44.372913 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-57f3525d-347c-4f93-906e-d22358af6fc5 req-bffb14d5-811b-476a-b302-2621209162ec service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.373373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-57f3525d-347c-4f93-906e-d22358af6fc5 req-bffb14d5-811b-476a-b302-2621209162ec service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.385423 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-57f3525d-347c-4f93-906e-d22358af6fc5 req-bffb14d5-811b-476a-b302-2621209162ec service nova] Creating event network-vif-plugged:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:21:44.392315 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-57f3525d-347c-4f93-906e-d22358af6fc5 req-bffb14d5-811b-476a-b302-2621209162ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Dec 15 14:21:44.393235 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 558/1101] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:21:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:21:44.751532 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:44.752178 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:44.759302 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.759787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:44.760620 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:44.761059 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:45.157735 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:45.165167 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-1852ad01-9249-414a-83db-4a75eb837920 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1575 microversion: 2.1 time: 0.417349 Dec 15 14:21:45.165988 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 544/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:44 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1575 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:46.183851 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:21:46.184578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:21:46.191915 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.193116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.194419 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:21:46.194938 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:21:46.355155 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:21:46.365930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4360eb41-d431-4d6d-b6f6-769087593cdf tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1562 microversion: 2.1 time: 0.187296 Dec 15 14:21:46.371712 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 559/1103] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:21:46 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:21:53.932024 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:21:53.936728 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:21:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:22:04.370246 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1079314801", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-58796565", "security_groups": [{"name": "tempest-secgroup-smoke-1269419461"}], "block_device_mapping_v2": [{"uuid": "2e2b1f75-684a-43cd-bd11-ddf80e970064", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d45a2324-0e28-4a72-9746-c7e5b98cb828"}]}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:04.490985 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] validate_networks() for [('d45a2324-0e28-4a72-9746-c7e5b98cb828', None, None, None, None, None)] {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:22:04.857037 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:22:04.858624 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:22:04.859105 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:22:04.859539 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:22:04.859987 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:22:04.869084 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:04.869594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:04.870438 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:04.870915 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:04.887393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:22:04.891679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for user d9f2199655a14be1b65ddce9c76d789c and project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:22:04.945633 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:22:04.947757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e2b1f75-684a-43cd-bd11-ddf80e970064',volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:22:05.368355 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6d8956f2-443c-4a6d-a5b9-5866da856ede tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001794 Dec 15 14:22:05.369185 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 545/1104] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:22:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 14:22:05.379955 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-38fd37e7-41cb-478e-81a1-848af767d28e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:05.380578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-38fd37e7-41cb-478e-81a1-848af767d28e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:05.436698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-38fd37e7-41cb-478e-81a1-848af767d28e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:05.446766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-38fd37e7-41cb-478e-81a1-848af767d28e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1093 microversion: 2.1 time: 0.068471 Dec 15 14:22:05.446766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 560/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:05 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:06.461780 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:06.467602 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:06.469616 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.470072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.470866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:06.471313 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:06.532455 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:06.539678 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-91cd2d50-69d3-49c5-b2b7-90c3f42bb0d1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1143 microversion: 2.1 time: 0.082211 Dec 15 14:22:06.540270 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 546/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:06 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:07.558430 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:07.559141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:07.566568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.567020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.567878 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:07.568372 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:07.632498 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:07.640613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a841a31c-fccb-46e1-8ae7-e4a392c8d178 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1199 microversion: 2.1 time: 0.086110 Dec 15 14:22:07.641197 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 561/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:07 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:08.660618 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:08.661239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:08.667420 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.667876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.668686 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:08.669132 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:08.814593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:08.821992 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-91b17fa0-1380-40b5-ba74-819612d32c0a tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1277 microversion: 2.1 time: 0.165301 Dec 15 14:22:08.822587 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 547/1108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:08 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:09.168938 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-72450656-ec30-4a0b-bc42-32454fd3eaef req-310d3dd8-f82a-42b8-b1ba-8157fb6d046b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a103b57-3cd0-4e9f-877a-636aabdadd7c", "tag": "34ee6a29-ca52-4613-a2f8-9da356bd45e3"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:09.171404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:09.171404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:22:09.181096 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-72450656-ec30-4a0b-bc42-32454fd3eaef req-310d3dd8-f82a-42b8-b1ba-8157fb6d046b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:09.182199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-72450656-ec30-4a0b-bc42-32454fd3eaef req-310d3dd8-f82a-42b8-b1ba-8157fb6d046b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:09.196170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-72450656-ec30-4a0b-bc42-32454fd3eaef req-310d3dd8-f82a-42b8-b1ba-8157fb6d046b service nova] Creating event network-changed:34ee6a29-ca52-4613-a2f8-9da356bd45e3 for instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c on hv-cinder-81322 Dec 15 14:22:09.201531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-72450656-ec30-4a0b-bc42-32454fd3eaef req-310d3dd8-f82a-42b8-b1ba-8157fb6d046b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038571 Dec 15 14:22:09.202380 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 562/1109] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:22:09.838561 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:09.839174 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:09.845684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:09.846134 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:09.846911 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:09.847472 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:09.984677 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:09.993890 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b3b86a5d-2d10-4ca7-acaf-f1e3873b12ec tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.159066 Dec 15 14:22:09.994461 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 548/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:09 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:11.012017 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:11.012714 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:11.020171 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.020623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.021397 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:11.021834 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:11.164067 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:11.171798 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-548d864c-2471-41c5-b5da-7c2cbef9a166 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.163602 Dec 15 14:22:11.172379 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 563/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:11 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:12.188863 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:12.189516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:12.196866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.197330 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.198131 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:12.198568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:12.333867 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:12.341229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d47c24f1-9f93-4392-815e-1bc8386a270b tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.156601 Dec 15 14:22:12.341787 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 549/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:12 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:13.358771 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:13.359401 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:13.365697 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.366139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.366964 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:13.367337 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:13.501089 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:13.508212 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a7cde8f3-24fa-4ad0-acb7-6af7acbe0313 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.153224 Dec 15 14:22:13.508770 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 564/1113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:13 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:14.525464 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:14.526074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:14.533003 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.533447 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:14.534218 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:14.534655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:14.674560 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:14.681983 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d9693b87-a5f2-499d-a0ba-d68a51ae4a66 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.160198 Dec 15 14:22:14.682533 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 550/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:14 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:15.698977 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:15.699589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:15.706051 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:15.706499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:15.707300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:15.707730 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:15.841351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:15.848725 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-aa9e856f-70e2-47a5-a646-0b08de50f731 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.153517 Dec 15 14:22:15.849319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 565/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:15 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:16.866131 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:16.866677 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:16.872885 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.873328 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:16.874111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:16.875053 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:17.008315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:17.016906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-66725e74-2b0b-409f-b297-2cf224a72624 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.154495 Dec 15 14:22:17.017497 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 551/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:16 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:18.033632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:18.034241 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:18.040492 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.041010 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.041773 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:18.042200 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:18.174443 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:18.181820 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b3fb250c-d19e-43d4-884c-cf86db8fcb30 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.152016 Dec 15 14:22:18.182393 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 566/1117] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:18 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:19.198637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:19.199241 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:19.206679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.207122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.207891 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:19.208348 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:19.341029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:19.348397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-5cde83b4-bf9d-439b-8d1b-16dc16f45173 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.153625 Dec 15 14:22:19.348959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 552/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:19 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:20.365346 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:20.366021 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:20.372375 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:20.372764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:20.373561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:20.373992 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:20.441243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-1645d574-a81a-4b17-b4aa-ec5cd128cb10 req-9fd7d779-8ef4-418f-82d4-9ffb5bcee5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a103b57-3cd0-4e9f-877a-636aabdadd7c", "name": "network-vif-plugged", "status": "completed", "tag": "34ee6a29-ca52-4613-a2f8-9da356bd45e3"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:20.446093 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:20.446093 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:22:20.451309 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-1645d574-a81a-4b17-b4aa-ec5cd128cb10 req-9fd7d779-8ef4-418f-82d4-9ffb5bcee5bc service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:20.451833 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-1645d574-a81a-4b17-b4aa-ec5cd128cb10 req-9fd7d779-8ef4-418f-82d4-9ffb5bcee5bc service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:20.463601 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-1645d574-a81a-4b17-b4aa-ec5cd128cb10 req-9fd7d779-8ef4-418f-82d4-9ffb5bcee5bc service nova] Creating event network-vif-plugged:34ee6a29-ca52-4613-a2f8-9da356bd45e3 for instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c on hv-cinder-81322 Dec 15 14:22:20.469186 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-1645d574-a81a-4b17-b4aa-ec5cd128cb10 req-9fd7d779-8ef4-418f-82d4-9ffb5bcee5bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Dec 15 14:22:20.469929 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 553/1119] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:22:20.507116 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:20.514448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8e414494-eaa9-4e9e-9b9b-9f1b24bb6aa6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.152903 Dec 15 14:22:20.515024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 567/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:20 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:21.533213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:21.533908 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:21.540242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:21.540696 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:21.541475 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:21.541906 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:21.671949 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:21.679290 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-068c65c3-2174-4cc3-a260-308f12bd9f08 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1265 microversion: 2.1 time: 0.151330 Dec 15 14:22:21.679841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 554/1121] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:21 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:22.695856 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:22.696499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:22.702823 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.703275 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.704204 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.704642 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.837385 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:22.845214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f023696c-0d2e-4209-9381-9f2ffc4f4921 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1452 microversion: 2.1 time: 0.153157 Dec 15 14:22:22.845784 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 568/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:22 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:22.862233 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:22.862919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:22.868923 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.869442 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:22.870294 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:22.870816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:23.004180 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:23.011436 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-852b8901-4978-4370-a37b-251b3a716f35 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1452 microversion: 2.1 time: 0.153693 Dec 15 14:22:23.012006 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 555/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:22 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:25.106585 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-fe659801-9f1b-4817-aa88-855c344e0b9a req-471b53d6-9aff-4553-ada1-d4f84fae2495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a103b57-3cd0-4e9f-877a-636aabdadd7c", "tag": "34ee6a29-ca52-4613-a2f8-9da356bd45e3"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:25.108350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:25.108350 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:22:25.125170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-fe659801-9f1b-4817-aa88-855c344e0b9a req-471b53d6-9aff-4553-ada1-d4f84fae2495 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:25.126255 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-fe659801-9f1b-4817-aa88-855c344e0b9a req-471b53d6-9aff-4553-ada1-d4f84fae2495 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:25.138579 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-fe659801-9f1b-4817-aa88-855c344e0b9a req-471b53d6-9aff-4553-ada1-d4f84fae2495 service nova] Creating event network-changed:34ee6a29-ca52-4613-a2f8-9da356bd45e3 for instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c on hv-cinder-81322 Dec 15 14:22:25.145151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-fe659801-9f1b-4817-aa88-855c344e0b9a req-471b53d6-9aff-4553-ada1-d4f84fae2495 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042601 Dec 15 14:22:25.145801 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 569/1124] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:22:32.474879 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1369871241", "imageRef": "3db9137b-c28c-42e5-b642-f2af93ed5520", "flavorRef": "452"}} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:32.526832 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.network.neutron [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] validate_networks() for None {{(pid=116681) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:22:32.788892 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Flavor limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:22:32.789314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Image limits 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:22:32.789786 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Flavor pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:22:32.790196 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Image pref 0:0:0 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:22:32.790607 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.virt.hardware [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:22:32.800219 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.800673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.801485 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:32.801920 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:32.818804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Getting quotas for project 99b47e885967478d881c8805e651d746. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:22:32.822661 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.quota [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Getting quotas for user 86d4edab717c46aa9233eef64be6652f and project 99b47e885967478d881c8805e651d746. Resources: {'cores', 'ram', 'instances'} {{(pid=116681) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:22:32.833321 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Going to run 1 instances... {{(pid=116681) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:22:32.835577 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db9137b-c28c-42e5-b642-f2af93ed5520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:22:32.947032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-162155eb-97dd-4825-be83-e86108123466 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475805 Dec 15 14:22:32.947674 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 556/1125] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:22:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:22:32.958479 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6d26650f-b255-4ec2-9845-4c68ba7e9fcb tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:32.959179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6d26650f-b255-4ec2-9845-4c68ba7e9fcb tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:33.016424 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6d26650f-b255-4ec2-9845-4c68ba7e9fcb tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:33.023372 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6d26650f-b255-4ec2-9845-4c68ba7e9fcb tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1215 microversion: 2.1 time: 0.069565 Dec 15 14:22:33.024035 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 570/1126] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:32 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:34.040984 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:34.041673 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:34.048301 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.049076 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.049874 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:34.050314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:34.111230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:34.120437 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a7d0b750-827c-4d7e-8f65-3f1d67cb009f tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1219 microversion: 2.1 time: 0.083646 Dec 15 14:22:34.121029 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 557/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:34 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:35.138389 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:35.139036 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:35.146578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.147020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:35.148480 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:35.148480 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:35.222351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:35.222351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b88a16d7-0ed2-4e1d-927e-82f3cd0e24c0 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1267 microversion: 2.1 time: 0.085750 Dec 15 14:22:35.222351 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 571/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:35 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:36.238706 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:36.239298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:36.246452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:36.247012 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:36.247856 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:36.248397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:36.315307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:36.322626 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e58d5ed6-1227-44f0-afe3-0076893da111 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1273 microversion: 2.1 time: 0.088774 Dec 15 14:22:36.323189 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 558/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:36 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:37.340959 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:37.342282 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:37.348146 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5a228227-c758-4671-a965-81745e4a1b64 req-316efc77-e6e1-4d00-90d6-515f7b78c297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3797a31f-9ba1-4e01-8b21-45b69f9f3b71", "tag": "6fb01c2a-4b22-40d0-acf6-310060e5afd4"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:37.350414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:37.350414 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:22:37.351473 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.352045 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.356900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.356900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.366467 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5a228227-c758-4671-a965-81745e4a1b64 req-316efc77-e6e1-4d00-90d6-515f7b78c297 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:37.367194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5a228227-c758-4671-a965-81745e4a1b64 req-316efc77-e6e1-4d00-90d6-515f7b78c297 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:37.388791 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5a228227-c758-4671-a965-81745e4a1b64 req-316efc77-e6e1-4d00-90d6-515f7b78c297 service nova] Creating event network-changed:6fb01c2a-4b22-40d0-acf6-310060e5afd4 for instance 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 on hv-cinder-81322 Dec 15 14:22:37.397443 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5a228227-c758-4671-a965-81745e4a1b64 req-316efc77-e6e1-4d00-90d6-515f7b78c297 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054485 Dec 15 14:22:37.398725 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 559/1130] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:22:37.610195 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:37.617723 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-59aaeef6-d506-4a97-a551-c65691fe9a42 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.281120 Dec 15 14:22:37.618334 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 572/1131] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:37 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:38.635385 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:38.636140 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:38.642366 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.642815 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:38.643596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:38.644058 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:38.773700 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:38.780849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-96989f63-7dcb-44c9-b2a3-96281e41f8aa tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.150017 Dec 15 14:22:38.781403 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 560/1132] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:38 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:39.797410 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:39.798597 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:39.804894 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:39.805339 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:39.806108 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:39.806541 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:39.941752 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:39.949062 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2a2f18a7-ff7f-42bd-a16d-130714b89451 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.155498 Dec 15 14:22:39.949635 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 573/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:39 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:40.965717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:40.966262 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:40.972916 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:40.973361 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:40.974135 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:40.974564 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:41.104640 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:41.112524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-162e52e6-d829-470b-bfc4-8be8a7f59dc8 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.150598 Dec 15 14:22:41.113194 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 561/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:40 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:42.129214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:42.129822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:42.136369 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.136816 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.137594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.138042 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.269621 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:42.277519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-acdb8e72-a6ad-46b6-be99-f6a1c2ad354b tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.152668 Dec 15 14:22:42.278103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 574/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:42 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:42.598899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-09cf11e7-5d38-4fa6-b6de-58832acaef95 req-90b3979c-0f1e-4ef4-b39c-7682bd25c8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3797a31f-9ba1-4e01-8b21-45b69f9f3b71", "name": "network-vif-plugged", "status": "completed", "tag": "6fb01c2a-4b22-40d0-acf6-310060e5afd4"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:42.600665 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:42.600665 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:22:42.608087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-09cf11e7-5d38-4fa6-b6de-58832acaef95 req-90b3979c-0f1e-4ef4-b39c-7682bd25c8a3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:42.608534 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-09cf11e7-5d38-4fa6-b6de-58832acaef95 req-90b3979c-0f1e-4ef4-b39c-7682bd25c8a3 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:42.619793 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-09cf11e7-5d38-4fa6-b6de-58832acaef95 req-90b3979c-0f1e-4ef4-b39c-7682bd25c8a3 service nova] Creating event network-vif-plugged:6fb01c2a-4b22-40d0-acf6-310060e5afd4 for instance 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 on hv-cinder-81322 Dec 15 14:22:42.624660 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-09cf11e7-5d38-4fa6-b6de-58832acaef95 req-90b3979c-0f1e-4ef4-b39c-7682bd25c8a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030064 Dec 15 14:22:42.625239 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 562/1136] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:22:43.294246 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:43.294777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:43.301392 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.304168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.304168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:43.304168 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:43.432952 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:43.440176 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-67dca144-b62c-4a62-872a-cb5d51cd673d tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1315 microversion: 2.1 time: 0.149707 Dec 15 14:22:43.440745 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 575/1137] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:43 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:44.459575 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:44.460382 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:44.466842 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.467329 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.468214 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.468684 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.608674 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:44.616855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4e3c2184-0c9f-4860-85cb-1aeb3d284dce tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1464 microversion: 2.1 time: 0.163713 Dec 15 14:22:44.617428 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 563/1138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:44 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:44.653085 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:44.653568 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:44.660291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.660742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.661518 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.661953 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.686300 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:22:44.957713 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-ab62cd5f-3491-46e9-8dc7-b15aedb2a746 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 204 len: 0 microversion: 2.1 time: 0.308064 Dec 15 14:22:44.958308 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 576/1139] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:22:44 2021] DELETE /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:22:44.966692 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:44.967300 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:44.974108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.974555 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:44.975321 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:44.975753 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:45.108756 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:45.116283 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-30e22e61-3b95-4830-abc8-b62fe430c889 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1470 microversion: 2.1 time: 0.153523 Dec 15 14:22:45.117108 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 564/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:44 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:46.134884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:46.135613 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:46.142080 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:46.142525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.143305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:46.143739 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.277454 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:46.285729 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-5e67e983-f99c-4ba4-9513-de896a4e3f18 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1470 microversion: 2.1 time: 0.154983 Dec 15 14:22:46.286298 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 577/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:46 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:46.969033 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-41be64b9-19e7-4cf1-878b-485c0d2860b3 req-8542fdf3-cc40-4bf5-be1a-85e92d0156fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3797a31f-9ba1-4e01-8b21-45b69f9f3b71", "name": "network-vif-deleted", "tag": "6fb01c2a-4b22-40d0-acf6-310060e5afd4"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:22:46.971876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:22:46.971876 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:22:46.980082 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-41be64b9-19e7-4cf1-878b-485c0d2860b3 req-8542fdf3-cc40-4bf5-be1a-85e92d0156fa service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:46.980524 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-41be64b9-19e7-4cf1-878b-485c0d2860b3 req-8542fdf3-cc40-4bf5-be1a-85e92d0156fa service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:46.991954 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-41be64b9-19e7-4cf1-878b-485c0d2860b3 req-8542fdf3-cc40-4bf5-be1a-85e92d0156fa service nova] Creating event network-vif-deleted:6fb01c2a-4b22-40d0-acf6-310060e5afd4 for instance 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 on hv-cinder-81322 Dec 15 14:22:46.996806 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-41be64b9-19e7-4cf1-878b-485c0d2860b3 req-8542fdf3-cc40-4bf5-be1a-85e92d0156fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Dec 15 14:22:46.997399 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 565/1142] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:22:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 14:22:47.302637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:47.303199 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:47.309383 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.309828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.310600 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.311032 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.341881 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:47.342319 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:47.342764 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lazy-loading 'fault' on Instance uuid 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:22:47.382054 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d4edab717c46aa9233eef64be6652f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b47e885967478d881c8805e651d746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:22:47.389373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-3fcb847c-dfed-436d-95f4-d168ebf04e01 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 200 len: 1305 microversion: 2.1 time: 0.090557 Dec 15 14:22:47.390012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 578/1143] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:47 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:22:48.408315 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:22:48.409008 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] [instance: 3797a31f-9ba1-4e01-8b21-45b69f9f3b71] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:22:48.415055 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.415496 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:48.416298 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:22:48.416726 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:22:48.430188 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] HTTP exception thrown: Instance 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 could not be found. Dec 15 14:22:48.430764 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] Returning 404 to user: Instance 3797a31f-9ba1-4e01-8b21-45b69f9f3b71 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:22:48.431553 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-367bc0c0-78ae-4a34-8179-9acbddd2aa33 tempest-VolumesNegativeTest-1107774822 tempest-VolumesNegativeTest-1107774822-project] 10.222.0.36 "GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71" status: 404 len: 111 microversion: 2.1 time: 0.028766 Dec 15 14:22:48.432090 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 566/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:22:48 2021] GET /compute/v2.1/servers/3797a31f-9ba1-4e01-8b21-45b69f9f3b71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:23:04.543878 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:04.544527 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:04.547460 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-5c441132-f6b5-4ce0-89fd-68be54df7d33 req-1b9c630e-2c1a-44d1-8416-8519e8b65f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:23:04.549222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:23:04.549222 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:23:04.551299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.551760 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.552583 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.553020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.557495 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5c441132-f6b5-4ce0-89fd-68be54df7d33 req-1b9c630e-2c1a-44d1-8416-8519e8b65f29 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.558051 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-5c441132-f6b5-4ce0-89fd-68be54df7d33 req-1b9c630e-2c1a-44d1-8416-8519e8b65f29 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.569360 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-5c441132-f6b5-4ce0-89fd-68be54df7d33 req-1b9c630e-2c1a-44d1-8416-8519e8b65f29 service nova] Creating event network-changed:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:23:04.574560 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-5c441132-f6b5-4ce0-89fd-68be54df7d33 req-1b9c630e-2c1a-44d1-8416-8519e8b65f29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Dec 15 14:23:04.575544 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 567/1145] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:23:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:23:04.579589 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Going to try to terminate instance {{(pid=116680) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:23:04.866303 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-f9da6ddd-88ce-495f-98ee-704549bf8ce3 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "DELETE /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 204 len: 0 microversion: 2.1 time: 0.326640 Dec 15 14:23:04.868869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 579/1146] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:23:04 2021] DELETE /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:23:04.875803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:04.876594 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:04.883393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.883942 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:04.884853 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:04.885336 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:05.137838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:05.146343 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d86e864d-c40e-4fb3-8441-63469d6b5015 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1568 microversion: 2.1 time: 0.274787 Dec 15 14:23:05.146917 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 568/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:04 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:06.167848 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:06.168687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:06.177446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.178177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.179305 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.180001 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.318936 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:06.326489 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-63c2cb93-7c26-462e-920c-1fb5a0c603c0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1450 microversion: 2.1 time: 0.163183 Dec 15 14:23:06.327063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 580/1148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:06 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:06.905813 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-3e47140c-336e-4abf-8d21-992f6ed01af7 req-b092e790-1e9b-4acf-a480-70f29363717b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623f52db-82aa-423a-9b24-6eeac638c872", "name": "network-vif-deleted", "tag": "3d72ae9c-c585-49b8-882a-896f0401fd24"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:23:06.908709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:23:06.908709 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:23:06.915083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-3e47140c-336e-4abf-8d21-992f6ed01af7 req-b092e790-1e9b-4acf-a480-70f29363717b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:06.915521 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-3e47140c-336e-4abf-8d21-992f6ed01af7 req-b092e790-1e9b-4acf-a480-70f29363717b service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:06.926653 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-3e47140c-336e-4abf-8d21-992f6ed01af7 req-b092e790-1e9b-4acf-a480-70f29363717b service nova] Creating event network-vif-deleted:3d72ae9c-c585-49b8-882a-896f0401fd24 for instance 623f52db-82aa-423a-9b24-6eeac638c872 on hv-cinder-81322 Dec 15 14:23:06.931490 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-3e47140c-336e-4abf-8d21-992f6ed01af7 req-b092e790-1e9b-4acf-a480-70f29363717b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Dec 15 14:23:06.932116 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 569/1149] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:23:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:23:07.343799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:07.347882 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:07.351227 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.351675 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.352503 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:07.352930 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:07.424316 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b912c8f0524ebcb586198f3ef88ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa37dc44119489f8b5a8292cf40d8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:23:07.433783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-285441e9-d5da-47c0-ac67-17020b6e5567 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 200 len: 1219 microversion: 2.1 time: 0.091861 Dec 15 14:23:07.433783 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 581/1150] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:07 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:23:08.449802 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:08.450527 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] [instance: 623f52db-82aa-423a-9b24-6eeac638c872] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:23:08.456632 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.457087 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:08.457861 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:23:08.458299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:23:08.471206 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] HTTP exception thrown: Instance 623f52db-82aa-423a-9b24-6eeac638c872 could not be found. Dec 15 14:23:08.471801 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Returning 404 to user: Instance 623f52db-82aa-423a-9b24-6eeac638c872 could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:23:08.473370 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a67a01b4-d093-434c-8c1a-9ad512014fb6 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872" status: 404 len: 111 microversion: 2.1 time: 0.028198 Dec 15 14:23:08.473894 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 570/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:23:08 2021] GET /compute/v2.1/servers/623f52db-82aa-423a-9b24-6eeac638c872 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:23:08.698373 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b80c4cb5-a028-462b-8770-0dce6700fec0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] Calling method '.version_select at 0x7f9cbe81c1f0>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:23:08.768475 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b80c4cb5-a028-462b-8770-0dce6700fec0 tempest-TestShelveInstance-1163126400 tempest-TestShelveInstance-1163126400-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-349670718" status: 202 len: 0 microversion: 2.1 time: 0.073861 Dec 15 14:23:08.769695 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 582/1152] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 14:23:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-349670718 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:23:20.797672 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:23:20.798251 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:23:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:24:22.766493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:22.767213 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:22.773032 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:22.773477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:22.774247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:22.774700 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:22.799232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Going to try to terminate instance {{(pid=116681) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:24:23.081349 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-60135ff1-20ff-44ce-bf0b-765b00dbf70c tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 204 len: 0 microversion: 2.1 time: 0.319149 Dec 15 14:24:23.081873 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 571/1153] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:24:22 2021] DELETE /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:24:23.091990 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:23.092554 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:23.099206 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:23.099700 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:23.100751 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:23.101192 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:23.426051 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:23.433885 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-833892f1-d0ed-495b-ab7a-b7c55c67cbff tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1576 microversion: 2.1 time: 0.347306 Dec 15 14:24:23.434449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 583/1154] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:23 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1576 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:24.451480 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:24.452204 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:24.458529 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:24.459003 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:24.459799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:24.460256 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:24.652366 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:24.659705 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-15ffd899-86e8-4764-875f-7c9f535b31f4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1576 microversion: 2.1 time: 0.212333 Dec 15 14:24:24.660310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 572/1155] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:24 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:25.678540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:25.680141 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:25.688361 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:25.689101 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:25.690210 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:25.690809 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:25.761637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:25.769324 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-97249809-24c8-4bd1-ba1f-fc6f375f8cfa tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1508 microversion: 2.1 time: 0.094581 Dec 15 14:24:25.769980 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 584/1156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:25 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1508 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:25.896425 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-d83fa100-f614-4ad8-b4ea-bf8768a58e2b req-5515672b-b3be-48c8-92e0-02ca90ab2466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a103b57-3cd0-4e9f-877a-636aabdadd7c", "name": "network-vif-deleted", "tag": "34ee6a29-ca52-4613-a2f8-9da356bd45e3"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:25.898844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:24:25.898844 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:24:25.905878 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-d83fa100-f614-4ad8-b4ea-bf8768a58e2b req-5515672b-b3be-48c8-92e0-02ca90ab2466 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:25.906325 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-d83fa100-f614-4ad8-b4ea-bf8768a58e2b req-5515672b-b3be-48c8-92e0-02ca90ab2466 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:25.917498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-d83fa100-f614-4ad8-b4ea-bf8768a58e2b req-5515672b-b3be-48c8-92e0-02ca90ab2466 service nova] Creating event network-vif-deleted:34ee6a29-ca52-4613-a2f8-9da356bd45e3 for instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c on hv-cinder-81322 Dec 15 14:24:25.922440 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-d83fa100-f614-4ad8-b4ea-bf8768a58e2b req-5515672b-b3be-48c8-92e0-02ca90ab2466 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088451 Dec 15 14:24:25.924505 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 573/1157] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:24:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:24:26.787476 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:26.788892 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:26.795687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:26.796272 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:26.797161 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:26.797671 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:26.829569 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:26.830016 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:26.830468 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.objects.instance [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lazy-loading 'fault' on Instance uuid 9a103b57-3cd0-4e9f-877a-636aabdadd7c {{(pid=116680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 14:24:26.871409 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:26.878989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-22d3ab1a-bd37-4447-b514-d7cecdc066c9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 200 len: 1229 microversion: 2.1 time: 0.095529 Dec 15 14:24:26.879559 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 585/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:26 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:27.899846 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:27.900585 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:27.906719 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:27.907170 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:27.907975 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:27.908420 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:27.922397 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] HTTP exception thrown: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. Dec 15 14:24:27.922992 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Returning 404 to user: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:24:27.923828 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6a660d0d-8430-49c7-9263-74e9b9a006d3 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 404 len: 111 microversion: 2.1 time: 0.029088 Dec 15 14:24:27.924405 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 574/1159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:27 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:24:28.014376 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-391601104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-58796565", "security_groups": [{"name": "tempest-secgroup-smoke-1269419461"}], "block_device_mapping_v2": [{"uuid": "2e2b1f75-684a-43cd-bd11-ddf80e970064", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d45a2324-0e28-4a72-9746-c7e5b98cb828"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:28.126150 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] validate_networks() for [('d45a2324-0e28-4a72-9746-c7e5b98cb828', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:24:28.544295 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:24:28.544722 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:24:28.545201 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:24:28.545611 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:24:28.546020 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:24:28.554716 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:28.555165 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:28.556008 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:28.556448 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:28.572657 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:24:28.576606 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for user d9f2199655a14be1b65ddce9c76d789c and project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:24:28.631170 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:24:28.633581 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e2b1f75-684a-43cd-bd11-ddf80e970064',volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:24:28.997048 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-81dff5ab-2f13-4afa-a534-441d9c51da7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.986386 Dec 15 14:24:28.997690 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 586/1160] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:24:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:24:29.008650 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-ccd1c73e-6c15-48d5-9c68-5fa8205113a8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:29.009260 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-ccd1c73e-6c15-48d5-9c68-5fa8205113a8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:29.061810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-ccd1c73e-6c15-48d5-9c68-5fa8205113a8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:29.068271 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-ccd1c73e-6c15-48d5-9c68-5fa8205113a8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1092 microversion: 2.1 time: 0.064210 Dec 15 14:24:29.069352 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 575/1161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:29 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:30.086732 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-860925af-d3bd-4ff7-bc74-374675f50973 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:30.087344 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-860925af-d3bd-4ff7-bc74-374675f50973 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:30.139095 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-860925af-d3bd-4ff7-bc74-374675f50973 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:30.146287 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-860925af-d3bd-4ff7-bc74-374675f50973 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1092 microversion: 2.1 time: 0.064478 Dec 15 14:24:30.147505 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 587/1162] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:30 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:31.164229 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-526914d6-4828-458a-8d47-fdc3858f57df tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:31.164865 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-526914d6-4828-458a-8d47-fdc3858f57df tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:31.218109 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-526914d6-4828-458a-8d47-fdc3858f57df tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:31.225311 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-526914d6-4828-458a-8d47-fdc3858f57df tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1092 microversion: 2.1 time: 0.064872 Dec 15 14:24:31.226050 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 576/1163] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:31 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:32.242889 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-7e160003-c925-4757-840c-7300f21463c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:32.243490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-7e160003-c925-4757-840c-7300f21463c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:32.294741 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-7e160003-c925-4757-840c-7300f21463c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:32.301130 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-7e160003-c925-4757-840c-7300f21463c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1092 microversion: 2.1 time: 0.062648 Dec 15 14:24:32.301687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 588/1164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:32 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1092 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:33.318111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:33.318786 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:33.325189 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:33.325637 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:33.326421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:33.326855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:33.385883 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:33.393175 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-33d9b411-9a26-4d53-9a64-0a563aa17b84 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1142 microversion: 2.1 time: 0.078859 Dec 15 14:24:33.393738 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 577/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:33 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1142 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:34.410101 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:34.410713 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:34.417546 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:34.417989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:34.418750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:34.419179 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:34.481321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:34.488734 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-74a2eb7b-2cdb-478f-95d3-ea5c85b8e471 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1190 microversion: 2.1 time: 0.082478 Dec 15 14:24:34.489291 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 589/1166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:34 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:35.506584 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:35.507182 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:35.513384 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:35.513830 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:35.514593 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:35.515021 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:35.749912 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:35.757765 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-b70ab327-1155-46e7-9774-cb2144a08e44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1276 microversion: 2.1 time: 0.255447 Dec 15 14:24:35.758351 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 578/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:35 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:36.572090 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-32d58333-a2bb-4ed4-aea2-9fd29a5b7ed5 req-06440e96-c90f-41db-b727-22f58457d7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2ef41c-1fd9-4684-8a2d-49d608e414ca", "tag": "5dd7fd16-29ae-4d71-978c-bfa23231432d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:36.574669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:24:36.574669 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:24:36.582771 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-32d58333-a2bb-4ed4-aea2-9fd29a5b7ed5 req-06440e96-c90f-41db-b727-22f58457d7dd service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:36.583357 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-32d58333-a2bb-4ed4-aea2-9fd29a5b7ed5 req-06440e96-c90f-41db-b727-22f58457d7dd service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:36.596408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-32d58333-a2bb-4ed4-aea2-9fd29a5b7ed5 req-06440e96-c90f-41db-b727-22f58457d7dd service nova] Creating event network-changed:5dd7fd16-29ae-4d71-978c-bfa23231432d for instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca on hv-cinder-81322 Dec 15 14:24:36.601777 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-32d58333-a2bb-4ed4-aea2-9fd29a5b7ed5 req-06440e96-c90f-41db-b727-22f58457d7dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034231 Dec 15 14:24:36.602404 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 590/1168] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:24:36.774596 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:36.775207 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:36.781574 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:36.782023 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:36.782798 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:36.783232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:36.975136 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:36.982847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-d10e8579-b1b0-4864-9174-69214f306143 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.212060 Dec 15 14:24:36.983717 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 579/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:36 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:38.001637 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:38.002323 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:38.008457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:38.008901 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:38.009659 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:38.010084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:38.145948 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:38.157304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-85365a84-c724-4d9d-8336-d2bc2ed27a9e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.156866 Dec 15 14:24:38.157304 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 591/1170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:37 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:39.171606 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:39.172243 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:39.179057 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:39.179506 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:39.180314 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:39.180751 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:39.314995 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:39.322393 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-45707191-d2d4-4ed3-a2e7-3e9fbaeb6132 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.154555 Dec 15 14:24:39.322959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 580/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:39 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:40.344514 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:40.345126 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:40.351446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:40.351893 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:40.352692 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:40.353121 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:40.489061 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:40.497013 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a35f66be-4d95-4d34-833d-62bc37e4d5f5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.156325 Dec 15 14:24:40.497584 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 592/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:40 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:41.514707 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:41.515299 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:41.521656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:41.522099 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:41.522872 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:41.523305 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:41.653816 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:41.661010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3cbb13d9-08c8-4237-9c64-01488b694da1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.150098 Dec 15 14:24:41.661568 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 581/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:41 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:42.678934 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:42.679547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:42.685864 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:42.686309 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:42.687084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:42.687516 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:42.821162 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:42.828313 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-33163161-1513-4063-9c8e-7a4293d2148e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.153870 Dec 15 14:24:42.828891 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 593/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:42 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:43.845364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:43.845970 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:43.852796 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:43.853247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:43.854017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:43.854480 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:43.986719 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:43.993962 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8da4b5e2-26b0-452a-8bb4-d6e4401b1b60 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.152359 Dec 15 14:24:43.994528 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 582/1175] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:43 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:45.010501 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:45.011119 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:45.017399 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:45.017843 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:45.018623 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:45.019052 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:45.152378 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:45.159962 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a092d93d-96e1-4ce1-9677-93da49578a44 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.153125 Dec 15 14:24:45.160811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 594/1176] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:45 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:24:46.176386 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:46.176997 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:46.183400 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:46.183855 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:46.184655 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:46.185088 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:46.317173 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:46.325107 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-e43f94f6-935f-4156-96dc-984408bdaad6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.152495 Dec 15 14:24:46.325668 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 583/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:46 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:47.217727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-fa094047-3fdd-49ef-91bd-146fa6043d0e req-b9840f0b-10ad-48bc-b031-bc1082c5252f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2ef41c-1fd9-4684-8a2d-49d608e414ca", "name": "network-vif-plugged", "status": "completed", "tag": "5dd7fd16-29ae-4d71-978c-bfa23231432d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:47.219321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:24:47.219321 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:24:47.226508 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-fa094047-3fdd-49ef-91bd-146fa6043d0e req-b9840f0b-10ad-48bc-b031-bc1082c5252f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:47.226943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-fa094047-3fdd-49ef-91bd-146fa6043d0e req-b9840f0b-10ad-48bc-b031-bc1082c5252f service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:47.237828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-fa094047-3fdd-49ef-91bd-146fa6043d0e req-b9840f0b-10ad-48bc-b031-bc1082c5252f service nova] Creating event network-vif-plugged:5dd7fd16-29ae-4d71-978c-bfa23231432d for instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca on hv-cinder-81322 Dec 15 14:24:47.243822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-fa094047-3fdd-49ef-91bd-146fa6043d0e req-b9840f0b-10ad-48bc-b031-bc1082c5252f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087132 Dec 15 14:24:47.244432 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 595/1178] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:24:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:24:47.342302 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:47.342919 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:47.349714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:47.349714 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:47.350827 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:47.351273 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:47.483617 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:47.490969 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-45a2f4bf-daa7-45d7-8234-b39e1f7d39e4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.152453 Dec 15 14:24:47.491530 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 584/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:47 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:48.509104 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:48.509800 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:48.515836 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:48.516310 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:48.517079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:48.517510 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:48.655737 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:48.663582 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-178d5557-658c-41ee-bd8a-9da2a93c2d7d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1264 microversion: 2.1 time: 0.159688 Dec 15 14:24:48.664173 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 596/1180] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:48 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:49.680608 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:49.681208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:49.687409 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.687859 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.688658 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.689086 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.824562 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:49.832010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-52622793-5195-4e48-bf80-a0b95f2bcfb9 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1452 microversion: 2.1 time: 0.155605 Dec 15 14:24:49.832577 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 585/1181] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:49 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:49.847822 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:24:49.848466 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:24:49.855545 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.856024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.856804 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:49.857238 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:49.989507 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:24:49.997349 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-cc77779b-ed48-4767-ae44-532bf16c13ce tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1452 microversion: 2.1 time: 0.153209 Dec 15 14:24:49.997945 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 597/1182] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:24:49 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:24:52.125963 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-ede1fc0d-3ffd-4a19-9494-fb85a2a8a4b5 req-4a54382e-e0f9-447b-b0bd-dc45ba20bb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2ef41c-1fd9-4684-8a2d-49d608e414ca", "tag": "5dd7fd16-29ae-4d71-978c-bfa23231432d"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:24:52.127493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:24:52.127493 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:24:52.135959 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-ede1fc0d-3ffd-4a19-9494-fb85a2a8a4b5 req-4a54382e-e0f9-447b-b0bd-dc45ba20bb54 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:24:52.136416 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-ede1fc0d-3ffd-4a19-9494-fb85a2a8a4b5 req-4a54382e-e0f9-447b-b0bd-dc45ba20bb54 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:24:52.149899 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-ede1fc0d-3ffd-4a19-9494-fb85a2a8a4b5 req-4a54382e-e0f9-447b-b0bd-dc45ba20bb54 service nova] Creating event network-changed:5dd7fd16-29ae-4d71-978c-bfa23231432d for instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca on hv-cinder-81322 Dec 15 14:24:52.155017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-ede1fc0d-3ffd-4a19-9494-fb85a2a8a4b5 req-4a54382e-e0f9-447b-b0bd-dc45ba20bb54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032749 Dec 15 14:24:52.155808 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 586/1183] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:24:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:25:13.950619 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:25:13.951174 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:25:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:26:39.556067 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1067341682", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-58796565", "security_groups": [{"name": "tempest-secgroup-smoke-1269419461"}], "block_device_mapping_v2": [{"uuid": "7608056c-0bf5-4a96-bafe-ade7d177d463", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d45a2324-0e28-4a72-9746-c7e5b98cb828"}]}} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:26:39.663650 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.network.neutron [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] validate_networks() for [('d45a2324-0e28-4a72-9746-c7e5b98cb828', None, None, None, None, None)] {{(pid=116680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 14:26:40.030720 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 14:26:40.031132 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image limits 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 14:26:40.031594 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Flavor pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 14:26:40.032028 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Image pref 0:0:0 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 14:26:40.032433 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.virt.hardware [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 14:26:40.040924 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:40.041360 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:40.042151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:40.042578 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:40.058338 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 14:26:40.062753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.quota [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Getting quotas for user d9f2199655a14be1b65ddce9c76d789c and project cd38f26fb8464e569d886ee7fa407464. Resources: {'cores', 'ram', 'instances'} {{(pid=116680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 14:26:40.119040 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Going to run 1 instances... {{(pid=116680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 14:26:40.121356 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7608056c-0bf5-4a96-bafe-ade7d177d463',volume_size=None,volume_type=None)] {{(pid=116680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 14:26:40.445368 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-862168c9-2c63-4903-bc10-5def50403615 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.893913 Dec 15 14:26:40.446025 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 598/1184] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 14:26:39 2021] POST /compute/v2.1/servers => generated 406 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 14:26:40.457679 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4c7ada09-1b83-4b3f-b6c2-e0c11566e830 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:40.458470 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4c7ada09-1b83-4b3f-b6c2-e0c11566e830 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:40.511799 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4c7ada09-1b83-4b3f-b6c2-e0c11566e830 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:40.518797 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4c7ada09-1b83-4b3f-b6c2-e0c11566e830 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1093 microversion: 2.1 time: 0.066321 Dec 15 14:26:40.519370 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 587/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:40 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:40.815625 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:26:40.815804 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:26:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:26:41.536342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:41.537024 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:41.544548 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:41.545115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:41.545904 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:41.546490 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:41.612224 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:41.619574 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8da49850-c65f-4776-8bd1-c277347c4d58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1135 microversion: 2.1 time: 0.087593 Dec 15 14:26:41.620172 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 599/1186] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:41 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:42.637310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:42.638003 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:42.645875 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:42.646320 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:42.647104 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:42.647533 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:42.729681 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:42.737847 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-a3081268-e44e-4579-a154-833840dd961e tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1209 microversion: 2.1 time: 0.104746 Dec 15 14:26:42.738503 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 588/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:42 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:43.758997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:43.758997 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:43.762899 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:43.763560 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:43.764548 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:43.765115 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:43.946190 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:43.953525 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-59ad3c80-954f-409e-a416-afe04b0d59cc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.202687 Dec 15 14:26:43.954103 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 600/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:43 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:43.992389 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [req-86cc800b-53db-4506-89cc-37bc1cfdf116 req-8fd0200c-8d5e-47e3-aaa4-a88f59c5f74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bda21c6-c5dc-41ca-a84a-451f07e77a81", "tag": "911e3bf9-e1bb-45cc-9851-03e0ee54f49a"}]} {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:26:43.994347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:26:43.994347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: warnings.warn(msg) Dec 15 14:26:44.002766 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-86cc800b-53db-4506-89cc-37bc1cfdf116 req-8fd0200c-8d5e-47e3-aaa4-a88f59c5f74d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:44.003451 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [req-86cc800b-53db-4506-89cc-37bc1cfdf116 req-8fd0200c-8d5e-47e3-aaa4-a88f59c5f74d service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:44.019199 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.compute.server_external_events [req-86cc800b-53db-4506-89cc-37bc1cfdf116 req-8fd0200c-8d5e-47e3-aaa4-a88f59c5f74d service nova] Creating event network-changed:911e3bf9-e1bb-45cc-9851-03e0ee54f49a for instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 on hv-cinder-81322 Dec 15 14:26:44.021125 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [req-86cc800b-53db-4506-89cc-37bc1cfdf116 req-8fd0200c-8d5e-47e3-aaa4-a88f59c5f74d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033266 Dec 15 14:26:44.021736 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 589/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:26:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:26:44.971270 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:44.971828 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:44.978083 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:44.978531 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:44.979299 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:44.979727 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:45.114436 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:45.121875 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-bfeeb1c8-2267-45c2-85f5-b67345ecbd34 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.154435 Dec 15 14:26:45.122442 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 601/1190] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:44 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:46.139803 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:46.140551 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:46.146627 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:46.147074 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:46.147848 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:46.148307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:46.280203 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:46.287462 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-4b9736c0-ccbf-4805-b32c-d962f9515ce4 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.152644 Dec 15 14:26:46.288042 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 590/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:46 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:47.304455 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:47.305063 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:47.311565 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:47.312044 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:47.313011 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:47.313445 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:47.444561 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:47.451854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-b2d712eb-9441-4420-aa93-9e7091ba0fe8 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.151137 Dec 15 14:26:47.452446 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 602/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:47 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:48.468388 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:48.468998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:48.475310 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:48.475750 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:48.476538 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:48.476971 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:48.610941 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:48.618200 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-27a22d51-7204-498b-87b5-ac7ee78423da tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.153959 Dec 15 14:26:48.618757 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 591/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:48 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:49.635491 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:49.636143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:49.643000 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:49.643449 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:49.644248 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:49.644682 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:49.774547 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:49.782279 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a4803fb9-d53e-4868-854a-ee411448d304 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.150489 Dec 15 14:26:49.782838 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 603/1194] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:49 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:50.799296 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:50.799902 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:50.806208 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:50.806656 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:50.807430 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:50.807866 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:50.942654 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:50.950347 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8144a8f8-88a5-484d-977d-3018fd8199bc tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.154853 Dec 15 14:26:50.950905 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 592/1195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:50 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:51.967228 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:51.967862 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:51.974218 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:51.974742 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:51.975416 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:51.975847 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:52.113139 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:52.122989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-4ac005f9-3d60-4104-9ab4-e72afb121ee2 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.159889 Dec 15 14:26:52.128407 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 604/1196] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:51 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:53.140698 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:53.141303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:53.147168 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:53.147605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:53.148394 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:53.148821 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:53.281926 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:53.289227 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8102a951-e38b-4a11-b5ef-8bd27010d006 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.153269 Dec 15 14:26:53.289801 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 593/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:53 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:53.773387 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-891b55b1-b460-431c-a38a-987ea8e022cf req-af92fb4c-8923-4a29-b75b-357c8170c4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bda21c6-c5dc-41ca-a84a-451f07e77a81", "name": "network-vif-plugged", "status": "completed", "tag": "911e3bf9-e1bb-45cc-9851-03e0ee54f49a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:26:53.775027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:26:53.775027 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:26:53.783438 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-891b55b1-b460-431c-a38a-987ea8e022cf req-af92fb4c-8923-4a29-b75b-357c8170c4a2 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:53.785136 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-891b55b1-b460-431c-a38a-987ea8e022cf req-af92fb4c-8923-4a29-b75b-357c8170c4a2 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:53.794989 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-891b55b1-b460-431c-a38a-987ea8e022cf req-af92fb4c-8923-4a29-b75b-357c8170c4a2 service nova] Creating event network-vif-plugged:911e3bf9-e1bb-45cc-9851-03e0ee54f49a for instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 on hv-cinder-81322 Dec 15 14:26:53.800131 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-891b55b1-b460-431c-a38a-987ea8e022cf req-af92fb4c-8923-4a29-b75b-357c8170c4a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Dec 15 14:26:53.800721 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 605/1198] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:26:54.306307 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:54.306909 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:54.313893 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:54.314342 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:54.315164 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:54.315592 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:54.449998 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:54.457850 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-dd4a9879-3871-4cdd-a193-4e77b55424a5 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1265 microversion: 2.1 time: 0.155330 Dec 15 14:26:54.458523 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 594/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:54 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:55.475146 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:55.475839 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:55.483408 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:55.483852 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:55.484652 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:55.485082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:55.618632 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:55.626484 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-6b68b0be-fdad-439c-a7aa-da3edc5524c6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1452 microversion: 2.1 time: 0.155408 Dec 15 14:26:55.627049 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 606/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:55 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:55.646769 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:26:55.647498 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:26:55.654081 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:55.654549 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:55.655324 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:55.655776 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:55.787466 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:26:55.795400 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-46a8aaa0-262a-4a02-840f-4e73426281db tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1452 microversion: 2.1 time: 0.152326 Dec 15 14:26:55.795986 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 595/1201] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:26:55 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:26:57.955079 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-147256a7-f03d-4a78-8cfc-beb3be660f46 req-50828d76-4db9-4be4-a933-9cf83a1ba92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bda21c6-c5dc-41ca-a84a-451f07e77a81", "tag": "911e3bf9-e1bb-45cc-9851-03e0ee54f49a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:26:57.956753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:26:57.956753 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:26:57.963745 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-147256a7-f03d-4a78-8cfc-beb3be660f46 req-50828d76-4db9-4be4-a933-9cf83a1ba92e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:26:57.964216 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-147256a7-f03d-4a78-8cfc-beb3be660f46 req-50828d76-4db9-4be4-a933-9cf83a1ba92e service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:26:57.975499 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-147256a7-f03d-4a78-8cfc-beb3be660f46 req-50828d76-4db9-4be4-a933-9cf83a1ba92e service nova] Creating event network-changed:911e3bf9-e1bb-45cc-9851-03e0ee54f49a for instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 on hv-cinder-81322 Dec 15 14:26:57.981942 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-147256a7-f03d-4a78-8cfc-beb3be660f46 req-50828d76-4db9-4be4-a933-9cf83a1ba92e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029385 Dec 15 14:26:57.982549 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 607/1202] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:26:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:17.761463 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:28:17.762178 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: Wed Dec 15 14:28:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:28:33.968940 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:28:33.969516 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:28:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:28:37.578232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:37.579151 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:37.585190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:37.585715 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:37.586943 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:37.587674 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:37.614589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Going to try to terminate instance {{(pid=116681) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:28:37.673884 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-2aeada89-d0a9-4aa3-8821-87a38a37c4c9 req-70cf70fc-57d7-4df2-9c68-0fe5b5187919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bda21c6-c5dc-41ca-a84a-451f07e77a81", "tag": "911e3bf9-e1bb-45cc-9851-03e0ee54f49a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:28:37.675296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:28:37.675296 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:28:37.682805 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-2aeada89-d0a9-4aa3-8821-87a38a37c4c9 req-70cf70fc-57d7-4df2-9c68-0fe5b5187919 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:37.683177 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-2aeada89-d0a9-4aa3-8821-87a38a37c4c9 req-70cf70fc-57d7-4df2-9c68-0fe5b5187919 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:37.694552 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-2aeada89-d0a9-4aa3-8821-87a38a37c4c9 req-70cf70fc-57d7-4df2-9c68-0fe5b5187919 service nova] Creating event network-changed:911e3bf9-e1bb-45cc-9851-03e0ee54f49a for instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 on hv-cinder-81322 Dec 15 14:28:37.699900 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-2aeada89-d0a9-4aa3-8821-87a38a37c4c9 req-70cf70fc-57d7-4df2-9c68-0fe5b5187919 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122738 Dec 15 14:28:37.701698 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 608/1203] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:37.836111 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-8cc2d1b2-056e-4e43-a3f9-af8a8cd2206d tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 204 len: 0 microversion: 2.1 time: 0.263867 Dec 15 14:28:37.836810 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 596/1204] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:28:37 2021] DELETE /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:28:37.848231 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:37.849400 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:37.856964 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:37.857681 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:37.858540 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:37.858974 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:38.090388 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:38.098732 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-c6e3c7c3-1655-441c-8a53-fd9d0392ee63 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1577 microversion: 2.1 time: 0.257475 Dec 15 14:28:38.099326 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 609/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:37 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 14:28:39.117247 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:39.117956 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:39.124669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:39.125129 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:39.125923 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:39.126364 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:39.264242 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:39.271441 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-6cf8c917-99b2-4a93-b124-3608f8155835 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1458 microversion: 2.1 time: 0.158316 Dec 15 14:28:39.272017 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 597/1206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:39 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:28:39.910207 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-44085a13-37fc-41eb-b650-7b81d7ddd513 req-28dbeefc-b0e2-4450-9f99-f35adcf7bf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bda21c6-c5dc-41ca-a84a-451f07e77a81", "name": "network-vif-deleted", "tag": "911e3bf9-e1bb-45cc-9851-03e0ee54f49a"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:28:39.911782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:28:39.911782 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:28:39.919519 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-44085a13-37fc-41eb-b650-7b81d7ddd513 req-28dbeefc-b0e2-4450-9f99-f35adcf7bf08 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:39.919995 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-44085a13-37fc-41eb-b650-7b81d7ddd513 req-28dbeefc-b0e2-4450-9f99-f35adcf7bf08 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:39.930750 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-44085a13-37fc-41eb-b650-7b81d7ddd513 req-28dbeefc-b0e2-4450-9f99-f35adcf7bf08 service nova] Creating event network-vif-deleted:911e3bf9-e1bb-45cc-9851-03e0ee54f49a for instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 on hv-cinder-81322 Dec 15 14:28:39.936252 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-44085a13-37fc-41eb-b650-7b81d7ddd513 req-28dbeefc-b0e2-4450-9f99-f35adcf7bf08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029732 Dec 15 14:28:39.936918 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 610/1207] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:28:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:40.290122 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:40.290739 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:40.298630 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:40.299078 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:40.299871 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:40.300333 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:40.369774 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:40.377511 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-268ccf90-77bb-4092-8edb-e2297a8fef47 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 200 len: 1224 microversion: 2.1 time: 0.091126 Dec 15 14:28:40.378083 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 598/1208] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:40 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:28:41.394869 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:41.395485 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 2bda21c6-c5dc-41ca-a84a-451f07e77a81] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:41.402012 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:41.402462 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:41.403395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:41.403906 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:41.416503 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] HTTP exception thrown: Instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 could not be found. Dec 15 14:28:41.417087 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Returning 404 to user: Instance 2bda21c6-c5dc-41ca-a84a-451f07e77a81 could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:28:41.417902 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-2b19955c-e2e5-410d-83e0-62406b5a8639 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81" status: 404 len: 111 microversion: 2.1 time: 0.027253 Dec 15 14:28:41.418431 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 611/1209] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:41 2021] GET /compute/v2.1/servers/2bda21c6-c5dc-41ca-a84a-451f07e77a81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:28:44.757452 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:44.758669 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:44.760214 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-6a57c63c-a380-478c-b167-c4065f2e8c14 req-5555aca5-3d2d-4132-8c4a-26e12b836d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2ef41c-1fd9-4684-8a2d-49d608e414ca", "tag": "5dd7fd16-29ae-4d71-978c-bfa23231432d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:28:44.762810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:28:44.762810 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:28:44.765628 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:44.766071 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:44.766849 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:44.767278 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:44.771982 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-6a57c63c-a380-478c-b167-c4065f2e8c14 req-5555aca5-3d2d-4132-8c4a-26e12b836d78 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:44.772425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-6a57c63c-a380-478c-b167-c4065f2e8c14 req-5555aca5-3d2d-4132-8c4a-26e12b836d78 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:44.784897 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-6a57c63c-a380-478c-b167-c4065f2e8c14 req-5555aca5-3d2d-4132-8c4a-26e12b836d78 service nova] Creating event network-changed:5dd7fd16-29ae-4d71-978c-bfa23231432d for instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca on hv-cinder-81322 Dec 15 14:28:44.790082 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-6a57c63c-a380-478c-b167-c4065f2e8c14 req-5555aca5-3d2d-4132-8c4a-26e12b836d78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033893 Dec 15 14:28:44.790679 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 612/1210] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:28:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:44.795205 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Going to try to terminate instance {{(pid=116681) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 14:28:45.047589 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-beac80a3-2d37-4454-b305-da3e20610982 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 204 len: 0 microversion: 2.1 time: 0.294104 Dec 15 14:28:45.048629 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 599/1211] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:28:44 2021] DELETE /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 14:28:45.057197 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:45.058009 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:45.064799 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:45.065259 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:45.066084 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:45.066511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:45.263631 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.policy [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116680) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:45.271640 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-149313ac-ec71-4fa8-a7d9-5138c885cae6 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1577 microversion: 2.1 time: 0.218693 Dec 15 14:28:45.272488 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 613/1212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:45 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:28:46.289694 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:46.290400 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:46.297629 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:46.298072 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:46.298838 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:46.299265 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:46.433517 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:46.440910 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-7d803184-cc28-4f95-963a-169388322bb1 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1458 microversion: 2.1 time: 0.155338 Dec 15 14:28:46.441468 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 600/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:46 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:28:47.056151 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [req-31be7a16-2378-4f36-9970-0cfb14540f16 req-958842e9-0cae-4057-bf71-b5569d4dfe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2ef41c-1fd9-4684-8a2d-49d608e414ca", "name": "network-vif-deleted", "tag": "5dd7fd16-29ae-4d71-978c-bfa23231432d"}]} {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 14:28:47.057854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 14:28:47.057854 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: warnings.warn(msg) Dec 15 14:28:47.065879 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-31be7a16-2378-4f36-9970-0cfb14540f16 req-958842e9-0cae-4057-bf71-b5569d4dfe56 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:47.066318 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [req-31be7a16-2378-4f36-9970-0cfb14540f16 req-958842e9-0cae-4057-bf71-b5569d4dfe56 service nova] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:47.077943 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.compute.server_external_events [req-31be7a16-2378-4f36-9970-0cfb14540f16 req-958842e9-0cae-4057-bf71-b5569d4dfe56 service nova] Creating event network-vif-deleted:5dd7fd16-29ae-4d71-978c-bfa23231432d for instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca on hv-cinder-81322 Dec 15 14:28:47.082787 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [req-31be7a16-2378-4f36-9970-0cfb14540f16 req-958842e9-0cae-4057-bf71-b5569d4dfe56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030568 Dec 15 14:28:47.083557 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 614/1214] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 14:28:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 14:28:47.458230 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:47.458837 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:47.465477 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:47.465922 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:47.468303 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:47.468741 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:47.531345 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.policy [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2199655a14be1b65ddce9c76d789c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd38f26fb8464e569d886ee7fa407464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116681) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 14:28:47.538670 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-348557a7-9fb3-4714-8ebb-b294b64d9f58 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 200 len: 1223 microversion: 2.1 time: 0.084136 Dec 15 14:28:47.539232 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 601/1215] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:47 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 14:28:48.556229 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:48.556928 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 5b2ef41c-1fd9-4684-8a2d-49d608e414ca] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:48.563497 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:48.563991 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:48.564766 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:48.565202 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:48.577811 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] HTTP exception thrown: Instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca could not be found. Dec 15 14:28:48.578395 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Returning 404 to user: Instance 5b2ef41c-1fd9-4684-8a2d-49d608e414ca could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:28:48.579208 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-a8e3b713-b0f4-4012-90af-5d50743f1834 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca" status: 404 len: 111 microversion: 2.1 time: 0.027193 Dec 15 14:28:48.579733 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 615/1216] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:48 2021] GET /compute/v2.1/servers/5b2ef41c-1fd9-4684-8a2d-49d608e414ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:28:49.079513 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:49.080035 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.compute.api [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116681) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:49.087546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:49.087546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:49.087546 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:49.087841 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG oslo_concurrency.lockutils [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:49.101389 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.wsgi [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] HTTP exception thrown: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. Dec 15 14:28:49.102010 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Returning 404 to user: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. {{(pid=116681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:28:49.102834 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3853b067-51a2-4acd-bfd7-8d1fece9a7de tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 404 len: 111 microversion: 2.1 time: 0.027594 Dec 15 14:28:49.103373 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 602/1217] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 14:28:49 2021] DELETE /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:28:49.111634 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '>' {{(pid=116680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:49.112281 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.compute.api [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] [instance: 9a103b57-3cd0-4e9f-877a-636aabdadd7c] Fetching instance by UUID {{(pid=116680) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 14:28:49.118244 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:49.118687 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:49.119457 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 14:28:49.119888 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG oslo_concurrency.lockutils [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Lock "5558468a-fedb-47cf-8f35-4b962b2baa9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 14:28:49.133037 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.wsgi [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] HTTP exception thrown: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. Dec 15 14:28:49.133615 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: DEBUG nova.api.openstack.wsgi [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Returning 404 to user: Instance 9a103b57-3cd0-4e9f-877a-636aabdadd7c could not be found. {{(pid=116680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 14:28:49.134425 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO nova.api.openstack.requestlog [None req-8a6cd4c0-b424-4ab8-9113-6e662ccbc094 tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c" status: 404 len: 111 microversion: 2.1 time: 0.026541 Dec 15 14:28:49.134964 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: [pid: 116680|app: 0|req: 616/1218] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 14:28:49 2021] GET /compute/v2.1/servers/9a103b57-3cd0-4e9f-877a-636aabdadd7c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 14:28:50.560190 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: DEBUG nova.api.openstack.wsgi [None req-3a1b3c1e-cdd3-4cdd-a0db-23302efea8bb tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] Calling method '.version_select at 0x7f9cbe282c10>' {{(pid=116681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 14:28:50.636098 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO nova.api.openstack.requestlog [None req-3a1b3c1e-cdd3-4cdd-a0db-23302efea8bb tempest-TestVolumeBootPattern-1781761477 tempest-TestVolumeBootPattern-1781761477-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-58796565" status: 202 len: 0 microversion: 2.1 time: 0.079648 Dec 15 14:28:50.636688 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: [pid: 116681|app: 0|req: 603/1219] 10.222.0.36 () {58 vars in 1256 bytes} [Wed Dec 15 14:28:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-58796565 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 14:29:56.035837 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:29:56.036496 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: Wed Dec 15 14:29:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:31:37.779806 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:31:37.780511 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: Wed Dec 15 14:31:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:31:40.835134 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:31:40.835723 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:31:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:31:53.986605 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:31:53.987366 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:31:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:31:54.815715 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:31:54.816342 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: Wed Dec 15 14:31:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:32:03.201421 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:32:03.201851 dv-cinder-813229-4-iscsi devstack@n-api.service[116681]: Wed Dec 15 14:32:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 14:33:16.054143 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 14:33:16.054781 dv-cinder-813229-4-iscsi devstack@n-api.service[116680]: Wed Dec 15 14:33:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!